Uncategorized

Why are Transformer so effective in Large Language Models like ChatGPT by Jay Shah Podcast


Dr. Subbarao Kambhampati is a Professor of Computer Science at Arizona State University and the director of the Yochan lab where his research focuses on decision-making and planning, specifically in the context of human-aware AI systems. He has been named a fellow of AAAI, AAAS, and ACM in recognition of his research contributions and also received a distinguished alumnus award from the University of Maryland and IIT Madras.

Check out Rora: https://teamrora.com/jayshah
Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023
Rora’s negotiation philosophy:
https://www.teamrora.com/post/the-biggest-misconception-about-negotiating-salary
https://www.teamrora.com/post/job-offer-negotiation-lies

00:00:00 Highlights and Intro
00:02:16 What is chatgpt doing?
00:10:27 Does it really learn anything?
00:17:28 Chatgpt hallucinations & getting facts wrong
00:23:29 Generative vs Predictive Modeling in AI
00:41:51 Learning common patterns from Language
00:57:00 Implications in society
01:03:28 Can we fix chatgpt hallucinations? 
01:26:24 RLHF is not enough
01:32:47 Existential risk of AI (or chatgpt) 
01:49:04 Open sourcing in AI
02:04:32 OpenAI is not “open” anymore
02:08:51 Can AI program itself in the future?
02:25:08 Deep & Narrow AI to Broad & Shallow AI
02:30:03 AI as assistive technology – understanding its strengths & limitations
02:44:14 Summary

Articles referred to in the conversation
https://thehill.com/opinion/technology/3861182-beauty-lies-chatgpt-welcome-to-the-post-truth-world/

More about Prof. Rao
Homepage: https://rakaposhi.eas.asu.edu/
Twitter: https://twitter.com/rao2z

Also check-out these talks on all available podcast platforms: https://jayshah.buzzsprout.com

About the Host:
Jay is a Ph.D. student at Arizona State University.
Linkedin: https://www.linkedin.com/in/shahjay22/
Twitter: https://twitter.com/jaygshah22
Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

Stay tuned for upcoming webinars!

***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Checkout these Podcasts on YouTube: https://www.youtube.com/c/JayShahml
About the author: https://www.public.asu.edu/~jgshah1/





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *