AI/LLM

Large Language Model AI (LLMs)

I often use these for answering questions (usually technical, occasionally political).

commercial services

• ChatGPT (by OpenAI, which is neither open nor AI)
• Copilot (Microsoft)
• FastGPT: seems to be Kagi's own model, not just a front-end to some other LLM
  • Kagi's Docs: Kagi AI
  • 2023-03-16 Kagi's approach to AI in search
• Perplexity
  • What software is needed for training a large language model (LLM)?

ideas

• LLMs could make federated search (of which I think YaCy is currently the only exemplar) actually workable/useful:
  • You type in your search -- either as keywords or as a natural-language query.
  • A search is done (however LLMs do it currently -- I don't know if they fine-tune the search parameters or just pass them on to a search engine).
  • The LLM then processes/glosses the top results to look for pages that seem to be most applicable to the request. If nothing passes a threshold test, it looks at the next bunch of results. If it can't find anything likely, it summarizes what it did find and notes that it may not be what you're looking for.
• I'd like to see an LLM browser plugin that can find tabs based on natural-language queries -- "where's the one with that medical form?" "Have I stashed any tabs about...[subject]?". Similarly, an app or library which can take a URL, load the corresponding web page, and produce a summary and keywords would also be hella useful.

Notes

• 2024-10-07 GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models (paper by Apple researchers; via)
• 2023-05-24 Worried About Sending Your Data to a Chatbot? 'PrivateGPT' Is Here

Code Sources

• Auto-GPT «chains together LLM "thoughts", to autonomously achieve whatever goal you set.»
  • Downside: not fully autonomous; still depends on OpenAI
• privateGPT