The History & Future of Prompt Engineering
A recently published research paper on arXiv was entirely authored by ChatGPT 3.5 Turbo and ChatGPT.
Introduction
A newly published paper delves into the ๐ฒ๐๐ผ๐น๐๐๐ถ๐ผ๐ป ๐ผ๐ณ ๐ฝ๐ฟ๐ผ๐บ๐ฝ๐ ๐ฒ๐ป๐ด๐ถ๐ป๐ฒ๐ฒ๐ฟ๐ถ๐ป๐ด, revealing how far weโve come and whatโs on the horizon.
Iโve transformed this studyโs data into a visual snapshot that highlights both past ๐ฎ๐ฑ๐๐ฎ๐ป๐ฐ๐ฒ๐บ๐ฒ๐ป๐๐ and ๐ณ๐๐๐๐ฟ๐ฒ trends.
Since 2022, weโve seen a shift from traditional language generation to innovative techniques like ๐บ๐๐น๐๐ถ๐บ๐ผ๐ฑ๐ฎ๐น ๐ฝ๐ฟ๐ผ๐บ๐ฝ๐๐ถ๐ป๐ด, ๐บ๐๐น๐๐ถ-๐๐๐ฟ๐ป ๐ฐ๐ผ๐ป๐๐ฒ๐ฟ๐๐ฎ๐๐ถ๐ผ๐ป๐, and ๐ฑ๐ผ๐บ๐ฎ๐ถ๐ป-๐๐ฝ๐ฒ๐ฐ๐ถ๐ณ๐ถ๐ฐ ๐ธ๐ป๐ผ๐๐น๐ฒ๐ฑ๐ด๐ฒ ๐ถ๐ป๐๐ฒ๐ด๐ฟ๐ฎ๐๐ถ๐ผ๐ป.
Key future developments include ๐ฟ๐ฒ๐ถ๐ป๐ณ๐ผ๐ฟ๐ฐ๐ฒ๐บ๐ฒ๐ป๐ ๐น๐ฒ๐ฎ๐ฟ๐ป๐ถ๐ป๐ด ๐๐ถ๐๐ต ๐ต๐๐บ๐ฎ๐ป ๐ณ๐ฒ๐ฒ๐ฑ๐ฏ๐ฎ๐ฐ๐ธ, better ๐ฐ๐ผ๐ป๐๐ฒ๐ ๐๐๐ฎ๐น ๐ถ๐ป๐๐ฒ๐ป๐ prediction, and more personalised user modelling.
Authors extensively used ChatGPT for content generation. ~ Source
The Prompts Used
Prompt #1: You are a scholar in machine learning and lan- guage models. I am writing a paper on the history of prompt engineering and generation. Can you give me a timeline for prompt engineering evolution? (We used this timeline to create prompts for each section later)
Prompt #2: Write the introduction of this paper. Emphasize that this paper focuses on how language prompts and queries have been used so far.
Prompt #3: Now generate history of prompting or querying in early language models an information retrieval
Prompt #4: Now write the history between 2010 and 2015 before attention mechanism was invented
Prompt #5: now write a section on how attention mechanism changed the future of prompt engineering in 2015
Prompt #6: now discuss how the advent of reinforcement learning techniques in 2017 changed the prompt engineering
Prompt #7: (a) Now write the section on developments in prompt engineering in 2019. (b) Now can you rewrite the section on developments in prompt engineering in 2019? Please organize your thoughts in paragraphs instead of bullet points.
Prompt #8: (a) now write the section for 2020 and 2021 in prompt engineering (b) now rewrite the section for 2020 and 2021 in prompt engineering? Please organize your thoughts in paragraphs instead of bullet points
Prompt #9: (a) Can you now write a section on 2022 and 2023 on advanced prompt techniques? (b) can you write the section on 2022 and 2023 on advanced prompt techniques in paragraphs instead of bullet points?
โจโจ Follow me on LinkedIn! โจโจ
Iโm currently the Chief Evangelist @ Kore.ai I explore and write about all things at the intersection of AI and language; ranging from LLMs, Chatbots, Voicebots, Development Frameworks, Data-Centric latent spaces and more.
