Awesome List Updates on Mar 12, 2024

14 awesome lists updated today.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Ai Collective Tools

Image Generator

• Bing Image Creator - Image Creator from Microsoft Designer allows you to generate captivating images based on your words using AI. freemium

• Playground AI - Free-to-use online tool to create art, social media posts, presentations, posters, videos, logos and more. #free

Real Estate

• VSDECO - Transform Your Space with Photorealistic Restyling #paid

2. Awesome Agi Cocosci

Meta-Level Considerations / Rationality

• Cognitive Science as a Source of Forward and Inverse Models of Human Decisions for Robotics and Control - Annual Review of Control, Robotics, and Autonomous Systems, 2022. [All Versions]. The review focuses on how cognitive science can provide forward models of human decision-making and inverse models of how humans think about others’ decision-making. The authors highlight relevant recent developments, including approaches that synthesize black box and theory-driven modeling, accounts that recast heuristics and biases as forms of bounded optimality, and models that characterize human theory of mind and communication in decision-theoretic terms.

3. Awesome Audit Algorithms

Papers / 2024

• FairProof: Confidential and Certifiable Fairness for Neural Networks - (Arxiv) Proposes an alternative paradigm to traditional auditing using crytographic tools like Zero-Knowledge Proofs; gives a system called FairProof for verifying fairness of small neural networks.

Papers / 2023

• XAudit : A Theoretical Look at Auditing with Explanations - (Arxiv) Formalizes the role of explanations in auditing and investigates if and how model explanations can help audits.

• Keeping Up with the Language Models: Robustness-Bias Interplay in NLI Data and Models - (Arxiv) Proposes a way to extend the shelf-life of auditing datasets by using language models themselves; also finds problems with the current bias auditing metrics and proposes alternatives -- these alternatives highlight that model brittleness superficially increased the previous bias scores.

4. Awesome Cropsteering

Components / Tasmota Configs

• M5 Stack - Standard 5×5cm functionally stacking modularized components hardware system

DIY / Modular systems

• Hydromisc (⭐491) - A single PCBA with all the necessary I/O to automate a typical small to mid-size hydroponic grow, controllable over Wifi. It may also be suitable for aquariums, ponds, or any other biological or chemical process involving water treatment

5. Amas

Ask these people anything!

• Jan-Hendrik Heuing (⭐0) - Developer, team lead, CTO, consultant.

6. Awesome Azure Openai Llm

RAG Pipeline & Advanced RAG

• Evaluation with Ragas: UMAP (often used to reduce the dimensionality of embeddings) with Ragas metrics for visualizing RAG results. [Mar 2024] / Ragas provides metrics: Context Precision, Context Relevancy, Context Recall, Faithfulness, Answer Relevance, Answer Semantic Similarity, Answer Correctness, Aspect Critique git (⭐6.2k) [May 2023]

Semantic Kernel / Semantic Kernel Glossary

• Architecting AI Apps with Semantic Kernel How you could recreate Microsoft Word Copilot [6 Mar 2024] Expand

DSPy / Semantic Kernel Glossary

• DSPy Documentation & Cheetsheet ref

• DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines [5 Oct 2023] / git (⭐16k)

• DSPy Explained! youtube [30 Jan 2024]

• DSPy RAG example in weviate recipes: recipes > integrations git (⭐432)

• Instead of a hard-coded prompt template, "Modular approach: compositions of modules -> compile". Building blocks such as ChainOfThought or Retrieve and compiling the program, optimizing the prompts based on specific metrics. Unifying strategies for both prompting and fine-tuning in one tool, Pythonic operations, prioritizing and tracing program execution. These features distinguish it from other LMP frameworks such as LangChain, and LlamaIndex. ref [Jan 2023]

• Automatically iterate until the best result is achieved: 1. Collect Data -> 2. Write DSPy Program -> 3. Define validtion logic -> 4. Compile DSPy program

  

• DSPy vs. LangChain, LlamaIndex: LangChain and LlamaIndex offer pre-built modules for specific applications. DSPy provides general-purpose modules that learn to optimize your language model based on your data and pipeline. It's like the difference between PyTorch (DSPy) and HuggingFace Transformers (higher-level libraries).

DSPy / DSPy Glossary

• Glossary reference to the ref.
  1. Signatures: Hand-written prompts and fine-tuning are abstracted and replaced by signatures.

     "question -> answer"
     "long-document -> summary"
     "context, question -> answer"
     

  2. Modules: Prompting techniques, such as Chain of Thought or ReAct, are abstracted and replaced by modules.

     # pass a signature to ChainOfThought module
     generate_answer = dspy.ChainOfThought("context, question -> answer")

  3. Optimizers (formerly Teleprompters): Manual iterations of prompt engineering is automated with optimizers (teleprompters) and a DSPy Compiler.

     # Self-generate complete demonstrations. Teacher-student paradigm, `BootstrapFewShotWithOptuna`, `BootstrapFewShotWithRandomSearch` etc. which work on the same principle.
     optimizer = BootstrapFewShot(metric=dspy.evaluate.answer_exact_match)

  4. DSPy Compiler: Internally trace your program and then optimize it using an optimizer (teleprompter) to maximize a given metric (e.g., improve quality or cost) for your task.
  • e.g., the DSPy compiler optimizes the initial prompt and thus eliminates the need for manual prompt tuning.

    cot_compiled = teleprompter.compile(CoT(), trainset=trainset, valset=devset)
    cot_compiled.save('turbo_gsm8k.json')

Prompt Guide & Leaked prompts / Prompt Template Language

• Power Platform GPT Prompts (⭐162) [Mar 2024]

LLM Materials for East Asian Languages / Japanese

• 日本語LLMまとめ - Overview of Japanese LLMs (⭐914): 一般公開されている日本語LLM（日本語を中心に学習されたLLM）および日本語LLM評価ベンチマークに関する情報をまとめ [Jul 2023]

• Azure OpenAI Service で始める ChatGPT/LLM システム構築入門 (⭐55): サンプルプログラム [Aug 2023]

• Matsuo Lab: 人工知能・深層学習を学ぶためのロードマップ ref / doc [Dec 2023]

7. Awesome Math

Encyclopedia

• 💲 The Princeton Companion to Mathematics - Timothy Gowers (Professor, Fields medallist), June Barrow-Green (Professor), and Imre Leader (Professor).

• 💲 Encyclopedia of Distances (4th Edition) - Michel Marie Deza, Elena Deza.

Foundations of Mathematics / Transition To Pure Rigour Math

• 📖💲 How to Prove It: A Structured Approach (3rd Edition) - Daniel J. Velleman (Professor).

8. Awesome Php

Table of Contents / Micro Frameworks

• Minicli (⭐1k) - Minimalist, dependency-free framework for building CLI-centric PHP applications.

Table of Contents / Code Analysis

• Editorconfig-Checker (⭐56) - A command line utility which verifies that your files implement your .editorconfig rules.

9. Awesome Bitcoin Payment Processors

Hosted Bitcoin Payment Processors / Non-Custodial

• Processor: Zaprite

  Fees: $25 per month

  Lightning: Yes

  Directly to Your Wallet: Yes

  Conversion to Fiat: No

  Requirements: No

10. Awesome Openstreetmap

Libraries / Python

• QuackOSM (⭐66) - A Python library for downloading, filtering and transforming *.osm.pbf files into GeoParquet files using DuckDB.

11. Awesome Generative Deep Art

Online Tools and Applications

• Persuva: Persuva is the AI-driven platform to create persuasive, high-converting ad copy at scale.

LLM Evaluation / Multi-agents

• qcri/LLMeBench (⭐73): Benchmarking Large Language Models

• TruLens for LLMs: Evaluate and Track LLM Applications

Auxiliary tools and concepts / Deforum

• Interviews Chat: Your Personal Interview Prep & Copilot

12. Urban and Regional Planning Resources

Platforms and Software Resources / Transportation Planning Tools and Platforms

• OpenPath - Continusous travel survey platform from NREL that collects trips and data via a smart phone app backed by a server and leveraging automated data processing.

13. Awesome Godot

Plugins and scripts / Various Godot versions

• Virtual Joystick (⭐667) - A virtual joystick for touchscreens. Simple to use and with useful options (Godot 3.x, 4.x).

14. Static Analysis

Other / Other

• lintian — Static analysis tool for Debian packages.

• proselint (⭐4.3k) — A linter for English prose with a focus on writing style instead of grammar.

• Prev: Mar 13, 2024
• Next: Mar 11, 2024