One of the questions that I have been particularly interested in since the early days of the OpenAI Scholars Program has been how reasoning and inference can be improved in Natural Language Understanding (NLU). Existing methods attain reasoning by using various forms of neural network models or ensemble learning, mainly on the task of Question … Continue reading GPT-2 for Question Answering
“We learn more by looking for the answer to a question and not finding it than we do from learning the answer itself.” The Chronicles of Prydain (1964), Lloyd Alexander For the past few weeks, I have been working on learning more about the Question Answering (QA) task with a focus on reasoning in my … Continue reading Multi-Step Reasoning for Better Question Answering
I have recently completed my study of Chris Manning's NLP course, which has left me with a paradoxical notion that I have gained a considerably solid foundation in NLP studies; there is still so much to learn and I know nothing. NLP clearly fascinates me and I am looking forward to working on problems that … Continue reading Causal Reasoning: Initial Observations
For the last two weeks, I have been mainly focusing on my learning on NLP and implementation of some of the NLP tasks, such as machine translation. It is fascinating how new findings of deep learning topics that are actively being researched can alter the course of new research considerably suddenly and lead to new … Continue reading Attention to Transformers
Reasoning has recently become an emerging area of study within Artificial General Intelligence (AGI) and offers an exciting potential to substantially improve the potential of NLP studies. Its existing applications to NLP shows makes the goals and tasks of NLP an even more difficult challenge, but it also leads researchers closer to achieve the goals … Continue reading NLP by Reasoning and Backpropagation
I have spent the past ten days by reading some of the well-known research papers on deep learning and more specifically on Natural Language Processing (NLP). Soon after drafting a syllabus and tweaking it a little with the feedback from my mentor, I also dived into watching Dr. Chris Manning’s CS224n Natural Language Processing with … Continue reading Natural Language Processing in the Making
“Our intelligence is what makes us human, and AI is an extension of that quality.” – Yann LeCun I am extremely excited to have officially started my journey in AI as an OpenAI Scholar. Throughout the next 12 weeks, I will document my progress through my weekly blog posts. February 1st was the first day … Continue reading OpenAI Scholars Program Week I: The Journey Begins!