Awesome List Updates on Aug 19, 2024

10 awesome lists updated today.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Azure Openai Llm

Build an LLMs from scratch: picoGPT and lit-gpt / GPT series release date

• Transformer Explainer: an open-source interactive tool to learn about the inner workings of a Transformer model (GPT-2) git [8 Aug 2024]

  Expand
  • Beam Search [1977] in Transformers is an inference algorithm that maintains the beam_size most probable sequences until the end token appears or maximum sequence length is reached. If beam_size (k) is 1, it's a Greedy Search. If k equals the total vocabularies, it's an Exhaustive Search. ref [Mar 2022]

  Classification of Attention

  • ref: Must-Read Starter Guide to Mastering Attention Mechanisms in Machine Learning [12 Jun 2023]

  1. Encoder-Decoder Attention:

     1. Soft Attention: assigns continuous weights to input elements, allowing the model to attend to multiple elements simultaneously. Used in neural machine translation.
     2. Hard Attention: selects a subset of input elements to focus on while ignoring the rest. Used in image captioning.
     3. Global Attention: focuses on all elements of the input sequence when computing attention weights. Captures long-range dependencies and global context.
     4. Local Attention: focuses on a smaller, localized region of the input sequence when computing attention weights. Reduces computational complexity. Used in time series analysis.

  2. Extended Forms of Attention: Only one Decoder component (only Input Sequence, no Target Sequence)

     1. Self Attention: attends to different parts of the input sequence itself, rather than another sequence or modality. Captures long-range dependencies and contextual information. Used in transformer models.
     2. Multi-head Self-Attention: performs self-attention multiple times in parallel, allowing the model to jointly attend to information from different representation subspaces.

  3. Other Types of Attention:

     1. Sparse Attention: reduces computation by focusing on a limited selection of similarity scores in a sequence, resulting in a sparse matrix. It includes implementations of “strided” and “fixed” attention. ref [23 Oct 2020]

     1. Cross-Attention: mixes two different embedding sequences, allowing the model to attend to information from both sequences. In a Transformer, when the information is passed from encoder to decoder that part is known as Cross Attention. ref / ref [9 Feb 2023]

     2. Sliding Window Attention (SWA): A technique used Longformer. It uses a fixed-size window of attention around each token, which allows the model to scale efficiently to long inputs. Each token attends to half the window size tokens on each side. ref (⭐9.4k)

Caching / OSS Alternatives for OpenAI Code Interpreter (aka. Advanced Data Analytics)

• Prompt caching with Claude: Reducing costs by up to 90% and latency by up to 85% for long prompts. [15 Aug 2024]

LLMOps: Large Language Model Operations / Math

• Azure ML Prompt flow: A set of LLMOps tools designed to facilitate the creation of LLM-based AI applications [Sep 2023] > How to Evaluate & Upgrade Model Versions in the Azure OpenAI Service [14 Aug 2024]

2. Awesome Vue

Resources / Podcasts

• DejaVue - The Vue podcast to remember

Resources / Examples

• umo editor (⭐119) - Umo Editor is an open-source document editor, based on Vue3 and Tiptap. Visit Playground for a fast experience.

Projects Using Vue.js / Open Source

• Go-Vue-Chat-Starter (⭐3) - A simple chat application starter project built with Vue.js and Go, featuring WebSocket communication, PrimeVue/PrimeFlex for the UI.

Components & Libraries / UI Components

• navpress (⭐1) - NavPress is a CLI tool for generating static navigation websites. It allows you to quickly build a navigation site through a configuration file.

• vue-speedometer (⭐59) - Vue component for showing speedometer like gauge using d3.

• Vue-Player (⭐2) - Lightweight, customizable, and easy-to-implement vue video player.

• vue3-select-component (⭐37) - Vue 3 Select Component, single & multi-select, best-in-class DX support with TypeScript end-to-end typesafe, easy styling, slots and more ~4.4KB

Components & Libraries / Scaffold

• mevn-boilerplate (⭐145) - ⭐️ the most comprehensive mevn stack boilerplate. ⭐️ mongodb - express - vue 3 (admin dashboard) - nodejs - nuxt 3 (client) boilerplate (pinia, tiptap, slug, vuetify and vuexy and more...) 🎉

3. Awesome Webaudio

Resources / Tutorials

• audio-katas (⭐53) - A collection of self-guided katas during which you will build a DAW of your own while getting exposed to the key Web Audio APIs.

4. Awesome Vite

Templates / React

• React Dapp Starter (⭐1) - Enterprise-ready Web3 DApp starter with TypeScript, TailwindCSS, Web3Modal, Wagmi, Shadcn UI, Zustand, and TanStack Query for scalable decentralized applications.

Framework-agnostic Plugins / Testing

• @poyro/vitest (⭐27) - Test LLM integrations using Vitest.

Framework-agnostic Plugins / Security

• vite-plugin-csp-guard (⭐1) - Lets you configure a Content Security Policy to your project, supports all directives and hashing.

WordPress / Community

• WordPlate (⭐2.1k) - Starter app with Composer.

TYPO3 CMS / Community

• vite-plugin-typo3 (⭐2) - Frontend integration for TYPO3 CMS.

5. Awesome Cl

Parsing html / Isomorphic web frameworks

• cl-html5-parser (⭐55) - HTML5 parser for Common Lisp. GPL3.0.
  • a port of the Python library html5lib.
  • compared to Plump: Plump is a mix of an XML and an HTML parser and breaks on some HTML rules (example (⭐119)), while cl-html5-parser is a fully compliant HTML parser.

6. Awesome Rust

Libraries / Computation

• Science
  • Axect/Peroxide (⭐486) - Rust numeric library containing linear algebra, numerical analysis, statistics and machine learning tools in pure rust
  • cpmech/russell (⭐101) - Rust Scientific Library for numerical mathematics, ordinary differential equations, special math functions, high-performance (sparse) linear algebra

Libraries / Date and time

• arthurhenrique/rusti-cal (⭐52) [rusti-cal] - A cal(1) clone lightning-fast ~ more than 9999 years ~ Written in Rust.

7. Awesome Naming

Tools, Applications, Libraries, Frameworks

• CockroachDB - Database application, that is marketed as being so fault tolerant and resilient as a cockroach.

8. Awesome Angular

AI / Google Developer Experts

• deep-chat (⭐1.4k) - Fully customizable AI chatbot component for your website.

HTTP / Google Developer Experts

• angular-odata (⭐47) - A fluent API for querying, creating, updating and deleting OData resources in Angular.

9. Awesome Sysadmin

Software / VPN

• Gluetun VPN client (⭐7.1k) - VPN client in a thin Docker container for multiple VPN providers, written in Go, and using OpenVPN or Wireguard, DNS over TLS, with a few proxy servers built-in. MIT docker

10. Awesome Zsh Plugins

Completions / superconsole - Windows-only

• chezmoi (⭐0) - Adds completions and aliases for chezmoi. Detects if you have git aliases and generates chezmoi aliases for them.

Themes / superconsole - Windows-only

• netmask (⭐0) - Termux-first theme. Includes decorators for ip address, full path to current directory, git status and python virtual environment.

• Prev: Aug 20, 2024
• Next: Aug 18, 2024