Awesome List Updates on Aug 23 - Aug 29, 2021
64 awesome lists updated this week.
🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor
1. Awesome V
Game development
- raylib.v (⭐66) - Updated V bindings for raylib with plans for complete cross-platform support.
- vraylib (⭐49) - V wrapper (bindings) for raylib, the C game development framework.
Operating system
- mmap (⭐6) - Provide native V-lang support for memory-mapping on Linux and Windows.
2. Awesome Icons
General
- Tilda Icons - Tilda Icons, is a website full of free icons for landing pages and more.
3. Awesome Imba
Resources / Toolkits and Frameworks
- Imba Inertia Adapter (⭐9) - Imba Inertia adapter.
Built with Imba / Apps/Websites
- Ping CRM (⭐16) - CRUD app with login, acccount, organizations and contacts management. Built with Inertia, Edgedb and Imba
4. Game Datasets
API
- Counter-Strike (⭐0) - data parsing for Counter-Strike: Global Offensive (CSGO).
5. Awesome Tall Stack
Libraries
- MarkdownX - An advanced Markdown Editor with dropdowns, image uploads, code blocks, and more.
Examples
- 🔐 devdojo.com - Developer Community and Tools
6. Awesome Keycloak
Deployment Examples
7. Awesome Neovim
Syntax / Diagnostics
- nvim-treesitter/nvim-treesitter-textobjects (⭐2.1k) - Create your own textobjects using tree-sitter queries.
8. Awesome Cassandra
Cassandra Distributions / Cassandra Compliant Databases on JVM
- DataStax Enterprise - Most widely used commercial distribution of Cassandra, integrated with Apache Spark (for SparkSQL, analytics), Apache Solr (for secondary index), Apache TinkerPop based Graph stored in Cassandra, and OpsCenter.
Cassandra Distributions / Cassandra as a Service / Managed Cassandra Based on Open Source Cassandra
- DataStax Astra - DataStax Astra Cassandra as a Service running on the Kubernetes operator Cassandra available on AWS and GCP.
9. Awesome Selfhosted
Software / Communication - Custom Communication Systems
- RetroShare - Secured and decentralized communication system. Offers decentralized chat, forums, messaging, file transfer. (Source Code (⭐1.7k))
GPL-2.0
C++
10. Awesome Digital History
Archives and primary sources / Switzerland
- histHub - The platform manages authority files on Swiss history.
11. Awesome Ironsworn
Hacks and homebrew / Ironsworn
- Arcanum - High magic for Ironsworn
- Spiritbound - A Studio Ghibli hack of Ironsworn
12. Awesome Rails
Jobs / Other external resources
13. Awesome Svelte
Animations / Checkbox
- svelte-typewriter - A simple and reusable typewriter effect for your Svelte applications.
14. Awesome Flutter
Backend / Redux / ELM / Dependency Injection
- NETCoreSync (⭐77) - Centralized database synchronization framework for multiple clients, built on top of Moor (⭐2.4k) library by Aldy J
Utilities / Game Engine resources
- Dart Code Metrics (⭐856) - Additional linter which reports code metrics, checks for anti-patterns and provides additional rules for the Dart analyzer by Dart Code Checker team.
15. Awesome Generative Deep Art
Image Synthesis / Multi-agents
16. Awesome Mac
Utilities / To-Do Lists
- Focused Work: Focus Timer - A simple, flexible Focus Timer.
17. Awesome Iam
Authentication / Identifiers
- API Tokens: A Tedious Survey - An overview and comparison of all token-based authentication schemes for end-user APIs.
Authorization / RBAC frameworks
- Oso (⭐3.5k) - A batteries-included library for building authorization in your application.
SAML / Other tools
- SAML is insecure by design - Not only weird, SAML is also insecure by design, as it relies on signatures based on XML canonicalization, not XML byte stream. Which means you can exploit XML parser/encoder differences.
18. Awesome Linux Containers
Containers
- youki (⭐4.9k)
A container runtime written in Rust.
19. Awesome Decentralized
Applications
- Hubzilla: General purpose platform for creating interconnected websites featuring a decentralized identity, communications, and permissions framework built using common webserver technology.
20. Awesome Vite
Framework-agnostic Plugins / Integrations
- vite-plugin-tauri (⭐152) - Integrate Tauri in a Vite project to build cross-platform apps.
21. Awesome Jmeter
Automation / DSL
- jmeter-java-dsl - Simple Java API to run JMeter performance tests in an VCS and programmers friendly way.
22. Awesome Inertiajs
Resources / Other
- Jetbrains plugin - PhpStorm/Intellij Ultimate plugin for Inertia.js.
23. Awesome Cli Apps
Files and Directories / Files
- RecoverPy (⭐1.2k) - Recover overwritten or deleted files.
24. Awesome Stacks Chain
Clarity Resources / Contracts
- CityCoin (⭐71) - An implementation of PoX lite using STX transfers to mint new coins using proportional probabilities.
25. Awesome Deno
Modules / Template engine
- handlebars (⭐29) - Handlebars template engine for deno
- mustache (⭐7) - Mustache template engine for deno
26. Urban and Regional Planning Resources
Public Data Resources / Equity and Environmental Justice
- Opportunity Atlas - These datasets provided by Opportunity Insights allow you to analyze social mobility and a variety of other outcomes from life expectancy to patent rates by neighborhood, college, parental income level, and racial background.
27. Awesome Fastapi
Videos / Other Tools
- Building a Stock Screener with FastAPI - A you build a web-based stock screener with FastAPI, you'll be introduced to many of FastAPI's features, including Pydantic models, dependency injection, background tasks, and SQLAlchemy integration.
28. Awesome Humane Tech
- MediLog - Android app to capture medical data, e.g. Blood Pressure and Weight as well as a simple Diary.
29. Awesome Remote Job
Tools / Communication
- flat.social - Create fun virtual spaces for online meetings, team activities and virtual socials.
30. Awesome Stock Resources
Photography / Public Domain
- NYPL Digital Collections - ©️ 180.000 items are Public Domain since January 6th 2016 Public Domain Collections: Free to Share & Reuse
- Project Apollo Archive - ©️ High-resolution Apollo imagery scanned by NASA's Johnson Space Center.
31. Awesome Integration
Projects / MaaS
- Amazon MQ - A fully managed message broker service that supports Apache ActiveMQ and RabbitMQ. It provides a reliable, secure, and scalable messaging infrastructure for your applications.
- Amazon MSK - A fully managed service for Apache Kafka that simplifies the setup, scaling, and management of Kafka clusters. It provides a highly available, durable, and performant messaging service for your data streaming needs.
- Amazon SQS - A fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. It offers a reliable, secure, and highly available message storage and delivery system.
- Amazon SNS - A fully managed pub/sub messaging service that enables you to send and receive messages between distributed systems, microservices, and event-driven serverless applications. It offers a flexible, scalable, and cost-effective way to notify subscribers of events and messages.
- Alibaba Cloud Message Queue for Apache Kafka - A fully managed Apache Kafka service that provides high-throughput, low-latency, and highly available message streaming for your applications. It offers easy integration with other Alibaba Cloud services and seamless data migration.
- Alibaba Cloud Message Queue for RabbitMQ - A distributed and fully managed messaging service that provides high scalability, low latency, and high throughput for your applications. It offers flexible deployment options, easy management, and robust security features.
- Alibaba Cloud Message Service - A distributed messaging and notification service that enables concurrent operations and message transfer between applications and decoupled systems. It offers high reliability, scalability, and fault tolerance for your messaging needs.
- AlibabaMQ for Apache RocketMQ - A distributed message queue service that supports reliable message-based asynchronous communication among microservices, distributed systems, and serverless applications. It provides high availability, scalability, and durability for your message streaming needs.
- Anypoint MQ - An enterprise-class cloud messaging service that is fully integrated with Anypoint Platform. It offers a flexible and reliable messaging infrastructure that enables you to integrate and orchestrate your applications and systems.
- Azure Service Bus - A reliable cloud messaging service that offers a variety of messaging patterns, such as pub/sub and request/response, and supports a range of protocols and standards.
- CloudAMQP - A RabbitMQ as a Service that provides a fully managed and scalable message broker service for your applications. It offers a simple and easy-to-use web-based management console, advanced monitoring and analytics, and seamless integration with other cloud services.
- CloudKarafka - An affordable and straightforward Kafka service that provides fully managed and scalable Kafka clusters on AWS and Google Cloud. It offers a user-friendly web-based dashboard, advanced security features, and seamless integration with other cloud services.
- Google Cloud Pub/Sub - A messaging and ingestion service that enables event-driven systems and streaming analytics. It provides high throughput, low latency, and reliable message delivery for your applications. It supports flexible messaging patterns, such as pub/sub and push/pull, and integrates seamlessly with other Google Cloud services.
- IBM MQ on Cloud - A cloud-based messaging service that enables seamless data transfer across enterprise applications, systems, and services with ease.
- IronMQ - An elastic message queue built specifically for the cloud, allowing for reliable and scalable message processing.
- Solace PubSub+ Cloud - An all-in-one event streaming, management, and insights platform, providing complete visibility and control over your data pipeline.
- Yandex Message Queue - A cloud messaging service with compatibility to Amazon SQS HTTP API, making it easy to integrate with existing systems and services.
- Yandex Managed Service for Apache Kafka - A fully-managed Apache Kafka service with automated scaling, monitoring, and maintenance, providing hassle-free data streaming.
Resources / Market Analysis
- API Management
- RPA
32. Awesome Crystal
Internationalization
- crystal-i18n (⭐24) - An internationalization library inspired by Ruby-I18n
- i18n.cr (⭐22) - Internationalization shard
33. Awesome Bitcoin Payment Processors
Hosted Bitcoin Payment Processors / Non-Custodial
Processor: Bitrequest
Fees: No fees
Lightning: Yes
Directly to Your Wallet: Yes
Conversion to Fiat: No
Requirements: No
34. Awesome Dart
Client Web App Frameworks
- MDL/Dart - Material Design Lite for Dart is a framework of components for web developers based on Google's Material Design philosophy.
35. Awesome Scientific Writing
Other Lists / Books
36. Awesome Testing
Software / Make your life easier
- DeepfakeHTTP (⭐503) - DeepfakeHTTP is a web server that uses HTTP dumps as a source for responses. This tool allows you to test clients against REST, GraphQL, and other APIs.
37. Awesome Datascience
Books / Visualization Tools
38. Awesome Earth
Food
- [CrowdFarming.com] - Buying food directly from farmers is the most powerful everyday act available to anyone to create a positive social and environmental impact.
Jobs
- Terra.do - Climate learning and career transition platform, runs several fellowships on climate education (broad and sector-specific), hosts climate job fairs, connects to mentors and experts, etc.
39. Awesome Productivity
Tools and Apps / Knowledge Management
- Obsidian.md - A knowledge base tool that works on local Markdown files. It allows you to create links between different notes.
40. Awesome Coq
Projects / Tools
- coq-tools (⭐37) - Scripts for manipulating Coq developments.
find-bug.py
- Automatically minimizes source files producing an error, creating small test cases for Coq bugs.absolutize-imports.py
- Processes source files to make loading of dependencies robust against shadowing of file names.inline-imports.py
- Creates stand-alone source files from developments by inlining the loading of all dependencies.minimize-requires.py
- Removes loading of unused dependencies.move-requires.py
- Moves all dependency loading statements to the top of source files.move-vernaculars.py
- Lifts many vernacular commands and inner lemmas out of proof script blocks.proof-using-helper.py
- Modifies source files to include proof annotations for faster parallel proving.
41. Awesome Scala Native
Bindings
- ncurses (⭐1) - Bindings for the GNU Ncurses Library.
42. Awesome Blazor
Books / Others
- Blazor in Action - An example-driven guide to building reusable UI components and web frontends—all with Blazor, C#, and .NET. (Manning Early Access Program began October 2020).
Courses / Others
- Getting Started with Blazor - June 2021 - Discover the Core Concepts of Blazor and learn to create web applications with ease.
Other Languages / Others
- ASP.NET Core Blazor 5.0: Blazor WebAssembly und Blazor Server: Moderne Single-Page-Web-Applications mit .NET, C# und Visual Studio - German book on Blazor (Published September 15, 2020 with montly Updates).
43. Awesome React Components
Responsive / Syntax Highlight
- cdbreact (⭐50) - demo - docs - Elegant UI Kit library and reusable components for building mobile-first, responsive websites and web apps.
44. Free for Dev
Code Quality
- Viezly - Enhanced code review tool for easier code reading and navigation. Free for Open Source and free for personal usage.
45. Awesome Machine Learning
Python / Reinforcement Learning
- RLlib (⭐33k) - RLlib is an industry level, highly scalable RL library for tf and torch, based on Ray. It's used by companies like Amazon and Microsoft to solve real-world decision making problems at scale.
46. Awesome Transit
GTFS Converters / Ruby
- gtfs2gps (⭐69) - An R package that converts public transportation data in GTFS format to GPS-like records in a
data.table
, where each row represents the timestamp of each vehicle at a given spatial resolution.
GTFS Data Collection and Maintenance Tools / Ruby
- TransitWand (⭐39) - An open source web and mobile application for collecting transit data. Use it to create GTFS feeds, capture passenger counts or generate GIS datasets.
47. Awesome Cl
Persistent object databases
- bknr.datastore (⭐111) - a CLOS-based lisp-only database in RAM with transaction logging persistence. Manual. licence.
- see also this good introductory blog post
- an example web application using bknr.datastore: screenshotbot-oss (⭐224).
- See also bknr.cluster (⭐23), if you want a highly-available replicated version of bknr.datastore.
Utils / Third-party APIs
- cl-etcd (⭐11) - Run etcd as an asynchronous inferior process. etcd is a strongly consistent, distributed key-value store. AGPL-3.0.
Command-line options parsers / Third-party APIs
- 👍 Clingon (⭐122) - a rich command-line options parser system.
- it may have the richest feature set: subcommands, generation of bash completion, support for various kinds of options (integers, booleans, counter, enums…), extensible…
48. Awesome Dos
Videos / Sound Blaster/OPL3
- Let's Code - MS DOS - by root42 - DOS programming tutorial series including VGA, SoundBlaster and VGA Mode X.
49. Awesome Clojurescript
Resources / Books
- Clojure, The Essential Reference – A reference book on the Clojure language and standard library.
50. Awesome Arcgis Developers
Spatial Analysis
- Client-side Geometry Engine - Allows you to test spatial relationships, calculate new geometries, and measure lengths, areas, distances, etc.
- ArcGIS API for JavaScript
geometryEngine
- Works for browsers and Node.js. - ArcGIS API for Python
arcgis.geometry
- ArcGIS Runtime API for .NET
GeometryEngine
- ArcGIS Runtime API for Android
GeometryEngine
- ArcGIS Runtime API for iOS
AGSGeometryEngine
- ArcGIS Runtime API for Java
GeometryEngine
- ArcGIS Runtime API for Qt
GeometryEngine
- ArcGIS API for JavaScript
Starter apps and CLIs
- Take a look at previously logged issues (⭐198).
51. Public Apis
Cloud Storage & File Sharing
API: AnonFiles
Description: Upload and share your files anonymously
Auth: No
HTTPS: Yes
CORS: Unknown
Postman:
API: BayFiles
Description: Upload and share your files
Auth: No
HTTPS: Yes
CORS: Unknown
Postman:
API: File.io
Description: Super simple file sharing, convenient, anonymous and secure
Auth: No
HTTPS: Yes
CORS: Unknown
Postman:
Cryptocurrency
API: Coinremitter
Description: Cryptocurrencies Payment & Prices
Auth:
apiKey
HTTPS: Yes
CORS: Unknown
Development
API: Contentful Images
Description: Used to retrieve and apply transformations to images
Auth:
apiKey
HTTPS: Yes
CORS: Yes
API: CORS Proxy (⭐35)
Description: Get around the dreaded CORS error by using this proxy as a middle man
Auth: No
HTTPS: Yes
CORS: Yes
Games & Comics
API: Cross Universe
Description: Cross Universe Card Data
Auth: No
HTTPS: Yes
CORS: Yes
API: Marvel
Description: Marvel Comics
Auth:
apiKey
HTTPS: Yes
CORS: Unknown
API: MMO Games
Description: MMO Games Database, News and Giveaways
Auth: No
HTTPS: Yes
CORS: No
Government
API: Gazette Data, UK
Description: UK official public record API
Auth:
OAuth
HTTPS: Yes
CORS: Unknown
Machine Learning
API: Perspective
Description: NLP API to return probability that if text is toxic, obscene, insulting or threatening
Auth:
apiKey
HTTPS: Yes
CORS: Unknown
Sports & Fitness
API: Oddsmagnet
Description: Odds history from multiple UK bookmakers
Auth: No
HTTPS: Yes
CORS: Yes
API: Sport Places
Description: Crowd-source sports places around the world
Auth: No
HTTPS: Yes
CORS: No
API: Sport Vision
Description: Identify sport, brands and gear in an image. Also does image sports captioning
Auth:
apiKey
HTTPS: Yes
CORS: Yes
Weather
API: Hong Kong Obervatory
Description: Provide weather information, earthquake information, and climate data
Auth: No
HTTPS: Yes
CORS: Unknown
API: Open-Meteo
Description: Global weather forecast API for non-commercial use
Auth: No
HTTPS: Yes
CORS: Yes
52. Awesome Capacitorjs
Guides
53. Magictools
Engines and Frameworks / Voxel Editors
- 🎉 boardgame.io (⭐10k) - State management and multiplayer networking for turn-based games.
- 🎉 Solar2D - A Lua based game engine with focus on ease of iterations and usage.
54. Awesome Pcaptools
Linux commands
- Bmon: (Bandwidth Monitor) is a tool similar to nload that shows the traffic load over all the network interfaces on the system. The output also consists of a graph and a section with packet level details. Screenshot
- Bwm-ng: (Bandwidth Monitor Next Generation) is another very simple real time network load monitor that reports a summary of the speed at which data is being transferred in and out of all available network interfaces on the system. Screenshot
- CBM: (Color Bandwidth Meter) A tiny little simple bandwidth monitor that displays the traffic volume through network interfaces. No further options, just the traffic stats are display and updated in realtime. Screenshot
- Collectl: reports system statistics in a style that is similar to dstat, and like dstat it gathers statistics about various different system resources like cpu, memory, network etc. Over here is a simple example of how to use it to report network usage/bandwidth. Screenshot
- Dstat: is a versatile tool (written in python) that can monitor different system statistics and report them in a batch style mode or log the data to a csv or similar file. This example shows how to use dstat to report network bandwidth Screenshot
- Ifstat: reports the network bandwidth in a batch style mode. The output is in a format that is easy to log and parse using other programs or utilities. Screenshot
- Iftop: measures the data flowing through individual socket connections, and it works in a manner that is different from Nload. Iftop uses the pcap library to capture the packets moving in and out of the network adapter, and then sums up the size and count to find the total bandwidth under use. Although iftop reports the bandwidth used by individual connections, it cannot report the process name/id involved in the particular socket connection. But being based on the pcap library, iftop is able to filter the traffic and report bandwidth usage over selected host connections as specified by the filter. Screenshot
- Jnettop: Jnettop is a traffic visualiser, which captures traffic going through the host it is running from and displays streams sorted by bandwidth they use. Screenshot
- Nethogs: is a small 'net top' tool that shows the bandwidth used by individual processes and sorts the list putting the most intensive processes on top. In the event of a sudden bandwidth spike, quickly open nethogs and find the process responsible. Nethogs reports the PID, user and the path of the program. Screenshot
- Netload: displays a small report on the current traffic load, and the total number of bytes transferred since the program start. No more features are there. Its part of the netdiag. Screenshot
- Netwatch: is part of the netdiag collection of tools, and it too displays the connections between local host and other remote hosts, and the speed at which data is transferring on each connection. Screenshot
- Nload: is a commandline tool that allows users to monitor the incoming and outgoing traffic separately. It also draws outa graph to indicate the same, the scale of which can be adjusted. Easy and simple to use, and does not support many options. Screenshot
- Pktstat: displays all the active connections in real time, and the speed at which data is being transferred through them. It also displays the type of the connection, i.e. tcp or udp and also details about http requests if involved. Screenshot
- Slurm: is 'yet' another network load monitor that shows device statistics along with an ascii graph. It supports 3 different styles of graphs each of which can be activated using the c, s and l keys. Simple in features, slurm does not display any further details about the network load. Screenshot
- Speedometer: Another small and simple tool that just draws out good looking graphs of incoming and outgoing traffic through a given interface. Screenshot
- Tcptrack: is similar to iftop, and uses the pcap library to capture packets and calculate various statistics like the bandwidth used in each connection. It also supports the standard pcap filters that can be used to monitor specific connections. Screenshot
- Trafshow: reports the current active connections, their protocol and the data transfer speed on each connection. It can filter out connections using pcap type filters. Screenshot
- Vnstat: is bit different from most of the other tools. It actually runs a background service/daemon and keeps recording the size of data transfer all the time. Next it can be used to generate a report of the history of network usage. Screenshot
Traffic Capture
- Libpcap/Tcpdump: The official site of tcpdump, a powerful command-line packet analyzer; and libpcap, a portable C/C++ library for network traffic capture.
- Ngrep (⭐847): strives to provide most of GNU grep's common features, applying them to the network layer. ngrep is a pcap-aware tool that will allow you to specify extended regular or hexadecimal expressions to match against data payloads of packets. It currently recognizes TCP, UDP and ICMP across Ethernet, PPP, SLIP, FDDI, Token Ring and null interfaces, and understands bpf filter logic in the same fashion as more common packet sniffing tools, such as tcpdump and snoop. Screenshot
- n2disk (Commercial): A multi-Gigabit network traffic recorder with indexing capabilities. n2disk is a network traffic recorder application. With n2disk you can capture full- sized network packets at multi-Gigabit rate (above 10 Gigabit/s on adequate hardware) from a live network interface, and write them into files without any packet loss.
- OpenFPC (⭐67): OpenFPC is a set of scripts that combine to provide a lightweight full-packet network traffic recorder & buffering tool. Its design goal is to allow non-expert users to deploy a distributed network traffic recorder on COTS hardware while integrating into existing alert and log tools.
- PF_RING: PF_RING is a new type of network socket that dramatically improves the packet capture speed. Available for Linux kernels 2.6.32 and newer. No need to patch the kernel. PF_RING-aware drivers for increased packet capture acceleration.
- TTT: (Tele Traffic Tapper) is yet another descendant of tcpdump but it is capable of real-time, graphical, and remote traffic-monitoring. ttt won't replace tcpdump, rather, it helps you find out what to look into with tcpdump. ttt monitors the network and automatically picks up the main contributors of the traffic within the time window. The graphs are updated every second by default.
Traffic Analysis/Inspection
- CoralReef: is a software suite developed by CAIDA to analyze data collected by passive Internet traffic monitors. It provides a programming library libcoral, similar to libpcap with extensions for ATM and other network types, which is available from both C and Perl.
- DPDK: is a set of libraries and drivers for fast packet processing. It was designed to run on any processors. The first supported CPU was Intel x86 and it is now extended to IBM Power 8, EZchip TILE-Gx and ARM. It runs mostly in Linux userland. A FreeBSD port is available for a subset of DPDK features.
- ECap: (External Capture) is a distributed network sniffer with a web front- end. Ecap was written many years ago in 2005, but a post on the tcpdump-workers mailing list requested a similar application... so here it is. It would be fun to update it and work on it again if there's any interest.
- EtherApe: is a graphical network monitor for Unix modeled after etherman. Featuring link layer, ip and TCP modes, it displays network activity graphically. Hosts and links change in size with traffic. Color coded protocols display. It supports Ethernet, FDDI, Token Ring, ISDN, PPP and SLIP devices. It can filter traffic to be shown, and can read traffic from a file as well as live from the network.
- Ipsumdump (⭐35): summarizes TCP/IP dump files into a self-describing ASCII format easily readable by humans and programs. Ipsumdump can read packets from network interfaces, from tcpdump files, and from existing ipsumdump files. It will transparently uncompress tcpdump or ipsumdump files when necessary. It can randomly sample traffic, filter traffic based on its contents, anonymize IP addresses, and sort packets from multiple dumps by timestamp. Also, it can optionally create a tcpdump file containing actual packet data. It's also convenient to work with CLICK as a inserted module.
- ITA: The Internet Traffic Archive is a moderated repository to support widespread access to traces of Internet network traffic, sponsored by ACM SIGCOMM. The traces can be used to study network dynamics, usage characteristics, and growth patterns, as well as providing the grist for trace- driven simulations. The archive is also open to programs for reducing raw trace data to more manageable forms, for generating synthetic traces, and for analyzing traces.
- Libcrafter (⭐297): is a high level library for C++ designed to make easier the creation and decoding of network packets. It is able to craft or decode packets of most common network protocols, send them on the wire, capture them and match requests and replies.
- Libnet (⭐876): is a collection of routines to help with the construction and handling of network packets. It provides a portable framework for low-level network packet shaping, handling and injection. Libnet features portable packet creation interfaces at the IP layer and link layer, as well as a host of supplementary and complementary functionality. Using libnet, quick and simple packet assembly applications can be whipped up with little effort.
- Multitail: now has a colorscheme included for monitoring the tcpdump output. It can also filter, convert timestamps to timestrings and much more.
- Netsniff-ng: Netsniff-ng is a toolkit of free Linux networking utilities, a Swiss army knife for your daily Linux network plumbing if you will.
- Network Expect: is a framework that allows to easily build tools that can interact with network traffic. Following a script, traffic can be injected into the network, and decisions can be taken, and acted upon, based on received network traffic. An interpreted language provides branching and high-level control structures to direct the interaction with the network. Network Expect uses libpcap for packet capture and libwireshark (from the Wireshark project) for packet dissection tasks. (GPL, BSD/Linux/OSX).
- Ntopng: Ntopng is the next generation version of the original ntop, a network traffic probe that shows the network usage, similar to what the popular top Unix command does. ntop is based on libpcap and it has been written in a portable way in order to virtually run on every Unix platform, MacOSX and on Win32 as well.
- pyshark: A Python wrapper for tshark, allowing python packet parsing using wireshark dissectors. There are quite a few python packet parsing modules, this one is different because it doesn't actually parse any packets, it simply uses tshark's (wireshark command-line utility) ability to export XMLs to use its parsing.
- Sanitize: Sanitize is a collection of five Bourne shell scripts for reducing tcpdump traces in order to address security and privacy concerns, by renumbering hosts and stripping out packet contents. Each script takes as input a tcpdump trace file and generates to stdout a reduced, ASCII file in fixed-column format.
- Socket Sentry (⭐2): Socket Sentry is a real-time network traffic monitor for KDE Plasma in the same spirit as tools like iftop and netstat.
- Tcpreplay (⭐1.1k): Replays a pcap file on an interface using libnet.
- Tcpslice (⭐7): Tcpslice is a tool for extracting portions of packet trace files generated using tcpdump's -w flag. It can combine multiple trace files, and/or extract portions of one or more traces based on time.
- Tcpsplit (⭐5): A tool to break a single libpcap packet trace into some number of sub- traces, breaking the trace along TCP connection boundaries so that a TCP connection doesn't end up split across two sub-traces. This is useful for making large trace files tractable for in- depth analysis and for subsetting a trace for developing analysis on only part of a trace.
- Tcpstat: Tcpstat reports certain network interface statistics much like vmstat does for system statistics. tcpstat gets its information by either monitoring a specific interface, or by reading previously saved tcpdump data from a file.
- WAND: A wonderful collection of tools built on libtrace to process network traffic, which is from The University of Waikato. I love this project!
- WinPcap: An extract of a message from Guy Harris on state of WinPcap and WinDump.
- Wireshark suit: The well-known tool suit to support packet analyzer and protocol decoder. It also includes a few practical tools and scripts to support most of the common usage.
File Extraction
- Snort: is an open source network intrusion prevention and detection system (IDS/IPS) developed by Sourcefire, now owned by Cisco. Combining the benefits of signature, protocol and anomaly- based inspection, Snort is the most widely deployed IDS/IPS technology worldwide.
- Dsniff: Dsniff is a collection of tools for network auditing and penetration testing. dsniff, filesnarf, mailsnarf, msgsnarf, urlsnarf, and webspy passively monitor a network for interesting data (passwords, e-mail, files, etc.). arpspoof, dnsspoof, and macof facilitate the interception of network traffic normally unavailable to an attacker (e.g, due to layer-2 switching). sshmitm and webmitm implement active monkey-in-the-middle attacks against redirected SSH and HTTPS sessions by exploiting weak bindings in ad-hoc PKI.
- Foremost (⭐48): is a console program to recover files based on their headers, footers, and internal data structures. This process is commonly referred to as data carving. Foremost can work on image files, such as those generated by dd, Safeback, Encase, etc, or directly on a drive. The headers and footers can be specified by a configuration file or you can use command line switches to specify built-in file types. These built-in types look at the data structures of a given file format allowing for a more reliable and faster recovery.
- Justniffer: Justniffer is a network protocol analyzer that captures network traffic and produces logs in a customized way, can emulate Apache web server log files, track response times and extract all "intercepted" files from the HTTP traffic.
- NetworkMiner: NetworkMiner is a Network Forensic Analysis Tool (NFAT) for Windows (but also works in Linux / Mac OS X / FreeBSD). NetworkMiner can be used as a passive network sniffer/packet capturing tool in order to detect operating systems, sessions, hostnames, open ports etc. without putting any traffic on the network. NetworkMiner can also parse PCAP files for off-line analysis and to regenerate/ reassemble transmitted files and certificates from PCAP files.
DNS Utilities
- dnsgram: dnsgram is a debugging tool for intermittent resolver failures. it takes one or more input PCAP files and generates statistics on 5 second segments allowing the study of intermittent resolver issues.
- dnsreplay: Dnsreplay takes recorded questions and answers and replays them to the specified nameserver and reporting afterwards which percentage of answers matched, were worse or better. Then compares the answers and some other metrics with the actual ones with those found in the dumpfile.
- dnsscan: dnsscan takes one or more INFILEs in PCAP format and generates a list of the number of queries per query type.
- dnsscope: dnsscope takes an input PCAP and generates some simple statistics outputs these to console.
- dnswasher: dnswasher takes an input file in PCAP format and writes out a PCAP file, while obfuscating end-user IP addresses. This is useful to share data with third parties while attempting to protect the privacy of your users.
Related Projects / Analysis
- BPF for Ultrix: A distribution of BPF for Ultrix 4.2, with both source code and binary modules.
- BPF+: Exploiting Global Data-flow Optimization in a Generalized Packet Filter Architecture By Andrew Begel, Steven McCanne, and Susan Graham.
- FFT-FGN-C: is a program for synthesizing a type of self-similar process known as fractional Gaussian noise. The program is fast but approximate. Fractional Gaussian noise is only one type of self-similar process. When using this program for synthesizing network traffic, you must keep in mind that it may be that the traffic you seek is better modeled using one of the other processes.
- Traffic Data Repository at the WIDE Project: It becomes increasingly important for both network researchers and operators to know the trend of network traffic and to find anomaly in their network traffic. This paper describes an on-going effort within the WIDE project to collect a set of free tools to build a traffic data repository containing detailed information of our backbone traffic. Traffic traces are collected by tcpdump and, after removing privacy information, the traces are made open to the public. We review the issues on user privacy, and then, the tools used to build the WIDE traffic repository. We will report the current status and findings in the early stage of our IPv6 deployment.
55. Awesome Coldfusion
Engines
- Lucee - Free, Open Source CFML Engine
56. Awesome Ros2
Packages / Ecosystem
- ROS2 For Unity (⭐298) - An asset package which enables high-performance communication between Unity3D simulations and ROS2 ecosystem.
Packages / Client libraries
- ros2cs (⭐69) - an alternative to ros2_dotnet, a ROS2 C# interface supporting full range of messages and modern ROS2.
57. Awesome Rust
Applications / System tools
- bottom (⭐9.6k) - Yet another cross-platform graphical process/system monitor.
Applications / Task scheduling
- delicate (⭐694) - A lightweight and distributed task scheduling platform.
Applications / Video
- harlanc/xiu (⭐1.7k) - A powerful and secure live server (rtmp/httpflv/hls/relay).
Libraries / GUI
- emoon/rust_minifb (⭐990) - minifb is a cross-platform window setup with optional bitmap rendering. It also comes with easy mouse and keyboard input. Primarily designed for prototyping
58. Awesome Security
Social Engineering / Forensics
- Gophish - An Open-Source Phishing Framework.
59. Awesome Playcanvas
Interactive Experiences
- Life During COVID-19 - Virtual art exhibition from charity Family for Every Child.
60. Awesome Lowcode
Automation
- Axiom - Browser automation. Quickly, without code.
Visual programming
- Heyflow - Build interactive flows.
- Storybook - Build component driven UIs faster.
61. Awesome Embedded Rust
Community / Community Chat Rooms
- embedded.rs-wasm-iot - English Telegram chat about Rust and WASM for microcontrollers and IoT
- #avr-rust:gitter.im - For discussion of using Embedded Rust on AVR devices
- #rp-rs:matrix.org - For discussion of using Embedded Rust on RP2040 based devices
- #stm32-rs:matrix.org - For discussion of using Embedded Rust on STM32 based devices
62. Awesome Vue
Projects Using Vue.js / Open Source
- Paper-Dashboard (⭐1.8k) -Creative Tim Paper Dashboard made for Vue
Components & Libraries / Frameworks
- Materio-vuetify-vuejs-admin-template-free (⭐775) - A Production ready, carefully crafted, most comprehensive Vuetify Vuejs admin template. Live demo
- Fes.js (⭐1.3k) - An easy-to-use front-end application framework based on vue3.
Components & Libraries / UI Layout
- simple-vue-grid (⭐3) - Simple grid containers that will help you to build layouts for your app.
Components & Libraries / UI Components
- vue-timer-hook (⭐170) - Vue 3 Timer module inspired by react-timer-hook
63. Awesome Db Tools
Schema / Changes
- Bytebase (⭐10k) - Web-based, zero-config, dependency-free database schema change and version control tool for teams.
64. Awesome Golem
GitHub Digest Blog Series
- Golem GitHub Digest #15 - Awesome, Goth improvements and towards Beta 3.
- Prev: Aug 30 - Sep 05, 2021
- Next: Aug 16 - Aug 22, 2021