Awesome List Updates on Oct 06, 2023

10 awesome lists updated today.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor

1. Awesome Jamstack

API / Database

• Fireproof - Zero dependency, offline-capable CRDT database, runs in the browser and connects to any cloud.

2. Awesome Vue

Components & Libraries / UI Components

• @f3ve/vue-markdown-it (⭐13) - A markdown-it component for Vue3. Easy to use and fully typed.

3. Awesome Neovim

Programming Languages Support / Diagnostics

• niuiic/typst-preview.nvim (⭐32) - Preview typst documents, respond to file changes.

4. Ai Collective Tools

Models

• Bloom - BLOOM by Hugging Face is a model similar to GPT-3

5. Awesome Azure Openai Llm

Finetuning / Llama Finetuning

• Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm Youtube / git (⭐205) [03 Sep 2023]
  

  Expand: KV Cache, Grouped Query Attention, Rotary PE

  Rotary PE

  def apply_rotary_embeddings(x: torch.Tensor, freqs_complex: torch.Tensor, device: str):
      # Separate the last dimension pairs of two values, representing the real and imaginary parts of the complex number
      # Two consecutive values will become a single complex number
      # (B, Seq_Len, H, Head_Dim) -> (B, Seq_Len, H, Head_Dim/2)
      x_complex = torch.view_as_complex(x.float().reshape(*x.shape[:-1], -1, 2))
      # Reshape the freqs_complex tensor to match the shape of the x_complex tensor. So we need to add the batch dimension and the head dimension
      # (Seq_Len, Head_Dim/2) --> (1, Seq_Len, 1, Head_Dim/2)
      freqs_complex = freqs_complex.unsqueeze(0).unsqueeze(2)
      # Multiply each complex number in the x_complex tensor by the corresponding complex number in the freqs_complex tensor
      # Which results in the rotation of the complex number as shown in the Figure 1 of the paper
      # (B, Seq_Len, H, Head_Dim/2) * (1, Seq_Len, 1, Head_Dim/2) = (B, Seq_Len, H, Head_Dim/2)
      x_rotated = x_complex * freqs_complex
      # Convert the complex number back to the real number
      # (B, Seq_Len, H, Head_Dim/2) -> (B, Seq_Len, H, Head_Dim/2, 2)
      x_out = torch.view_as_real(x_rotated)
      # (B, Seq_Len, H, Head_Dim/2, 2) -> (B, Seq_Len, H, Head_Dim)
      x_out = x_out.reshape(*x.shape)
      return x_out.type_as(x).to(device)

  KV Cache, Grouped Query Attention

    # Replace the entry in the cache
    self.cache_k[:batch_size, start_pos : start_pos + seq_len] = xk
    self.cache_v[:batch_size, start_pos : start_pos + seq_len] = xv
  
    # (B, Seq_Len_KV, H_KV, Head_Dim)
    keys = self.cache_k[:batch_size, : start_pos + seq_len]
    # (B, Seq_Len_KV, H_KV, Head_Dim)
    values = self.cache_v[:batch_size, : start_pos + seq_len]
  
    # Since every group of Q shares the same K and V heads, just repeat the K and V heads for every Q in the same group.
  
    # (B, Seq_Len_KV, H_KV, Head_Dim) --> (B, Seq_Len_KV, H_Q, Head_Dim)
    keys = repeat_kv(keys, self.n_rep)
    # (B, Seq_Len_KV, H_KV, Head_Dim) --> (B, Seq_Len_KV, H_Q, Head_Dim)
    values = repeat_kv(values, self.n_rep)

6. ALL About RSS

Web Feed Specifications

• Schema Structured Syndication ¹³⁵²

Apps / Outline Processor Markup Language

• Stratum ¹³⁴⁸

• FeedFlow ¹³⁵⁵

• Read Copilot ¹³⁶⁰

• Den for RSS ¹³⁶²

• ReadBot ¹³⁷⁰

Hosted Readers / Outline Processor Markup Language

• Vore ¹³⁴⁵

Other Apps / Outline Processor Markup Language

• PlainApp (⭐2.4k): with an RSS reader function built in ¹³³⁸

RSSHub / Outline Processor Markup Language

• https://rsshub.aierliz.xyz by 易燃又美味的凝胶

• https://rss.feiyuyu.net/ by 肥鱼

universally from / webpage/html

• RSSHub ¹³⁵⁹

• RSS Bridge ^{1353, 1359}

universally from / newsletter/mail

• Feed4Mail ¹³⁵⁰

specifically from (a certain platform) / Hacker News

• Hacker News RSS Feed for Busy People ¹³⁷¹

specifically from (a certain platform) / Annotation / Bookmarking

• LinkyRSS ¹³⁴¹

• Omnivore ¹³⁶⁸

RSS2NEWSLETTER / Docsify

• Digest ¹³⁶¹

RSS2Mastodon / Webpage Monitor Services with capability of monitoring RSS Feed 1264

• Mastofeed ¹²⁷²

• feedsin.space ¹³⁴⁴

Toolbox / Webpage Monitor Services with capability of monitoring RSS Feed 1264

• feedless ¹³⁴⁰

Obtain translated RSS feed / Webpage Monitor Services with capability of monitoring RSS Feed 1264

• RSS Translator ^{1372, 1412}

RSS Feed integrated with AI generated content / Webpage Monitor Services with capability of monitoring RSS Feed 1264

• RSSPath ¹³⁶³

• RSS-GPT (⭐282) ¹³⁶⁷

RSS Feed Finding/Detection / Webpage Monitor Services with capability of monitoring RSS Feed 1264

• RSS+

• Get RSS Feed URL (⭐206)

• RSS+Atom Feed Subscribe Button Generator

• FeedReader App ¹³⁶⁴

• RSS feed ASAP ¹³⁷³

Discussion Forums / Crypto or Blockchain relevant

• RSS-Public Mailing List

Official Mastodon Accounts of RSS relevant Apps/Tools/Services/Developers 1301 / Crypto or Blockchain relevant

• RSS ADVISORY BOARD: @[email protected]

Podcast Statistics / Crypto or Blockchain relevant

• Podcast-Standard ¹³⁵¹

7. Free for Dev

Monitoring

• bleemeo.com - Free for 3 servers, 5 uptime monitors, unlimited users, unlimited dashboards, unlimited alerting rules.

8. Awesome Playcanvas

IO Games

• Simply Up - Climb to the top of the tower in the shortest time.

9. Awesome Game Engine Dev

Game Engines / Specialty

• 🎉 Ren'Py (⭐4.7k) - Visual novel engine. [Website]

10. Awesome Zsh Plugins

Plugins / superconsole - Windows-only

• fzfsh (⭐2) - Add fzf (⭐63k) plugins for chezmoi, docker, git, kubectl and pass.

• incsearch (⭐5) - Friendlier vim mode for ZSH. Moves cursor with incremental search within current line.

• Prev: Oct 07, 2023
• Next: Oct 05, 2023