Awesome List Updates on Mar 08, 2024

10 awesome lists updated today.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Distraction Blocker

Apps and Tools / Windows

• FocusWriter - A distraction-free writing environment.

• Cold Turkey - Review - Block distracting websites and applications.

Apps and Tools / MacOS

• SelfControl - Review - A free and open-source application for Mac OS X that lets you block your own access to distracting websites.

• HeyFocus - Review - Block websites and applications to improve productivity.

Apps and Tools / Linux

• LeechBlock NG (⭐547) - A simple productivity tool designed to block distracting websites.

Apps and Tools / Browser Extensions

• StayFocusd - Review - Increase your productivity by limiting the amount of time spent on time-wasting websites.

• Freedom - Review - Block distractions on all of your devices.

Apps and Tools / Mobile Apps

• Forest - Review - Stay focused, be present, and turn your focused moments into a lovely forest.

• Offtime - Disconnect from smartphone overuse.

Research Papers / Mobile Apps

• Understanding and Developing Tools for Attention Management in Technology-Intensive Workplaces

Communities / Mobile Apps

• Productivity Directory - A directory for productivity tools and apps

• Productivity Blog - Top blog on Productivity

• r/productivity - The subreddit dedicated to productivity hacks and tips.

• Focusmate Community - A virtual co-working community to increase accountability and focus.

Contribution Guidelines / Mobile Apps

• Search previous suggestions before making a new one, as yours may be a duplicate.

• Suggested resources should be of high quality and well-documented.

• Comments on why the resource is worthwhile are encouraged.

• Make an individual pull request for each suggestion.

2. Awesome Polars

Resources / Blog posts

• Revisiting a Classic Cheminformatics Paper with Polars: The Wiener Index - A science blog post that uses Polars to track the information for the molecules in DataFrames by @bertiewooster.

3. Awesome Langchain

Tools / Services

• MindSQL (⭐168) - A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.

4. Awesome Svelte

Tutorials

• Setup Authentication with AuthJS and Sveltekit 2.0 - @bradcypert (YouTube)

State Libraries

• exome (⭐222) - Simple proxy based state manager for deeply nested states.

UI Libraries

• Skeleton - Skeleton uses Tailwind utility classes and design system to easily create theme-able user interfaces.

• M3 Svelte (⭐156) - Robust component library implementing Material Design 3

5. Awesome Azure Openai Llm

Finetuning / PEFT: Parameter-Efficient Fine-Tuning (Youtube) [24 Apr 2023]

• LoRA: Low-Rank Adaptation of Large Language Models: [cnt]: LoRA is one of PEFT technique. To represent the weight updates with two smaller matrices (called update matrices) through low-rank decomposition. git (⭐10k) [17 Jun 2021]

  Expand: LoRA Family
  1. LoRA+: Improves LoRA’s performance and fine-tuning speed by setting different learning rates for the LoRA adapter matrices. [19 Feb 2024]
  2. LoTR: Tensor decomposition for gradient update. [2 Feb 2024]
  3. The Expressive Power of Low-Rank Adaptation: Theoretically analyzes the expressive power of LoRA. [26 Oct 2023]
  4. DoRA: Weight-Decomposed Low-Rank Adaptation. Decomposes pre-trained weight into two components, magnitude and direction, for fine-tuning. [14 Feb 2024]
  5. LoRA Family ref [11 Mar 2024]
     • LoRA introduces low-rank matrices A and B that are trained, while the pre-trained weight matrix W is frozen.
     • LoRA+ suggests having a much higher learning rate for B than for A.
     • VeRA does not train A and B, but initializes them randomly and trains new vectors d and b on top.
     • LoRA-FA only trains matrix B.
     • LoRA-drop uses the output of B*A to determine, which layers are worth to be trained at all.
     • AdaLoRA adapts the ranks of A and B in different layers dynamically, allowing for a higher rank in these layers, where more contribution to the model’s performance is expected.
     • DoRA splits the LoRA adapter into two components of magnitude and direction and allows to train them more independently.
     • Delta-LoRA changes the weights of W by the gradient of A*B.
  6. 5 Techniques of LoRA ref: LoRA, LoRA-FA, VeRA, Delta-LoRA, LoRA+ [May 2024]

Quantization Techniques / Llama Finetuning

• The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. BitNet b1.58, in which every single parameter (or weight) of the LLM is ternary {-1, 0, 1}. [27 Feb 2024]

MLLM (multimodal large language model) / GPT series release date

• Anthrophic
  1. Claude 3 Opus, the largest version of the new LLM, outperforms rivals GPT-4 and Google’s Gemini 1.0 Ultra. Three variants: Opus, Sonnet, and Haiku. [Mar 2024]

Build an LLMs from scratch: picoGPT and lit-gpt / GPT series release date

• Spreadsheets-are-all-you-need (⭐1.1k): Spreadsheets-are-all-you-need implements the forward pass of GPT2 entirely in Excel using standard spreadsheet functions. [Sep 2023]

Evaluating Large Language Models / OSS Alternatives for OpenAI Code Interpreter (aka. Advanced Data Analytics)

• LLMPerf Leaderboard (⭐414): Evaulation the performance of LLM APIs. [Dec 2023]

6. Awesome Agi Cocosci

Abduction / Applications in AI

• Human Comprehensible Active Learning of Genome-Scale Metabolic Networks - AAAI Spring Symposium Series 2023 on Computational Scientific Discovery, 2023. [All Versions]. [Extended Abstract]. [Slides]. This work introduces a novel machine learning framework ILP-iML1515 based on Inductive Logic Programming (ILP) that performs abductive logical reasoning and actively learns from training examples. The ILP-iML1515 framework 1) allows high-throughput simulations and 2) actively selects experiments that reduce the experimental cost of learning gene functions in comparison to randomly selected experiments.

Domain Specific Language / Design Practises

• How Domain Experts Use an Embedded DSL - OOPSLA'23, 2023. This work conducts a thematic analysis identified five key themes, including: the interaction between the eDSL and the host language has significant and sometimes unexpected impacts on eDSL user experience, and users preferentially engage with domain-specific communities and code templates rather than host language resources.

7. Awesome Django

Third-Party Packages / Commands

• django-typer (⭐66) - Write Django management commands using the Typer CLI library.

8. Awesome Stacks

Graphweaver - GraphQL API Over Multiple Datasources ↗ / Resources

• Graphweaver - 🛠️ - 🐙 (⭐428) - Data Everywhere - Instant GraphQL.

• AWS Cognito - Pre-built integration with AWS Cognito.

• Connect to a datasource

9. Awesome Neovim

(requires Neovim 0.5)

• LukasPietzschmann/boo.nvim (⭐32) - Quickly pop-up some LSP-powered information of the thing your cursor is on.

10. Awesome Zsh Plugins

Plugins / superconsole - Windows-only

• ai-commands (⭐18) - Asks GPT (gpt-4-turbo-preview) for CLI commands that achieve the described target action.

Themes / superconsole - Windows-only

• acenoster (⭐13) - A multi-purpose theme with very detailed git and mercurial support. Also includes decorators for AWS profile name, virtual environment name if any, number of background tasks, current directory and previous command's exit code if non-zero.

• Prev: Mar 09, 2024
• Next: Mar 07, 2024