{"id":11831,"date":"2023-04-18T03:08:44","date_gmt":"2023-04-18T07:08:44","guid":{"rendered":"https:\/\/spinor.info\/weblog\/?p=11831"},"modified":"2023-04-18T03:08:44","modified_gmt":"2023-04-18T07:08:44","slug":"extending-gpt-4","status":"publish","type":"post","link":"https:\/\/spinor.info\/weblog\/?p=11831","title":{"rendered":"Extending GPT-4"},"content":{"rendered":"

So here is my latest conversation with GPT-4 using my custom user interface. The important features of this implementation are the following:<\/p>\n

    \n
  1. GPT is instructed to use LaTeX for mathematical output, which the UI correctly renders;<\/li>\n
  2. The UI captures and renders SVG graphics that GPT may generate;<\/li>\n
  3. GPT can use an external computer algebra tool<\/strong> for accurate computation;<\/li>\n
  4. GPT can invoke an external tool to perform Google searches<\/strong> for current information;<\/li>\n
  5. Conversations are condensed to ensure that they can run effectively indefinitely without hitting the token limit;<\/li>\n
  6. GPT is used efficiently (GPT3.5 used for summaries, GPT-4 for new queries);<\/li>\n
  7. The UI is optimized for easy printing (to PDF or hardcopy).<\/li>\n<\/ol>\n

    I was able to achieve this level of integration even without plugin-level access, simply by clever “prompt engineering” to ensure that the majority of the time, GPT uses the provided tools effectively. For this, GPT-4 seems essential; GPT3.5 is not really able to grasp the notion of using external tools before constructing its answers.<\/p>\n

    By way of example, when GPT was asked about the current Bank of Canada interest rate, what happened in the background was the following exchange:<\/p>\n

    User<\/strong>: What is the current Bank of Canada interest rate?<\/p>\n

    GPT<\/strong>: SEARCH(“current Bank of Canada interest rate”)<\/p>\n

    User<\/strong>: Snippet 1: Mar 8, 2023 … The current Bank of Canada interest rate sits at 4.50%, with a 0.25% rate hike announced on January 25, 2023.
    \nSnippet 2: See the Current Bank of Canada Interest Rate graphs at this page. You will read in the news about this rate when the Bank of Canada makes a rate\u00a0…
    \nSnippet 3: Find answers about questions you may have about the Bank of Canada. What is the current bank of Canada interest rate?<\/p>\n

    GPT<\/strong>: As of March 8, 2023, the current Bank of Canada interest rate is 4.50%. A 0.25% rate hike was announced on January 25, 2023.<\/p><\/blockquote>\n

    \"\"<\/p>\n

    The prompting that I use can of course be improved. The behavior of GPT-4 is not always consistent, sometimes it fails to make use of the computer algebra result or attempts to invoke computer algebra in the wrong place. I suspect that the “right” solution will have to wait until I have plugin-level developer access. But I am very happy that I was able to accomplish this already, in particular that access to Google and the computer algebra tool are completely automated in the background, requiring no user action.<\/p>\n<\/fb:like>","protected":false},"excerpt":{"rendered":"

    So here is my latest conversation with GPT-4 using my custom user interface. The important features of this implementation are the following: GPT is instructed to use LaTeX for mathematical output, which the UI correctly renders; The UI captures and renders SVG graphics that GPT may generate; GPT can use an external computer algebra tool […]<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58,35,36],"tags":[],"class_list":["post-11831","post","type-post","status-publish","format-standard","hentry","category-cybernetics","category-personal","category-programming","category-58-id","category-35-id","category-36-id","post-seq-1","post-parity-odd","meta-position-corners","fix"],"_links":{"self":[{"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=\/wp\/v2\/posts\/11831","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=11831"}],"version-history":[{"count":1,"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=\/wp\/v2\/posts\/11831\/revisions"}],"predecessor-version":[{"id":11833,"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=\/wp\/v2\/posts\/11831\/revisions\/11833"}],"wp:attachment":[{"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=11831"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=11831"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/spinor.info\/weblog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=11831"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}