Awesome List Updates on Jul 14 - Jul 20, 2014
19 awesome lists updated this week.
🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor
1. Awesome Haskell
Algorithmics
Theorem Provers - Official Website Resources.
Audio, Music & Sound
Audio, music and sound - official Website Resources.
Compilers
Compiler construction, lexing, parsing, pretty printing - Official Website Resources.
Concurrency & Parallelism
Concurrency & Parallelism - Official Website Info.
Cryptography & Hashing
Cryptography & Hashing - Official Website Resources.
Data Access
- Haxl (⭐4.1k) - a library for efficient, concurrent, concise data access.
Data Science
Robotics - Official Website Resources.
Data Structures
Data Structures & IO Libraries - Official Website Resources.
Database
Database Interfaces - Official Website Resources.
Development Tools
Development Libraries and Tools - Official Website Resources.
Distributed Computing
Distributed Computing - a collaborative Hackage list.
- Cloud Haskell - concurrent and distributed programming in Haskell.
Games
Games - Official Website Resources.
GUI
Graphical User Interface (GUI) Libraries - Official Website Resources.
Graphics
Graphics - Official Website Resources.
Network
Network - Official Website Resources
Web / Frameworks
- Interfaces to Frameworks - Official Website Resources.
IHP: Integrated Haskell Platform - The best way to get started with haskell web dev.
Web - a collaborative Hackage list of frameworks, libraries, ...
- HTTP (⭐171) - Haskell HTTP package. Supports client-side web programming in Haskell.
- hoauth2 (⭐123) - a lightweight oauth2 haskell binding.
Messaging
- amqp (⭐122) - client library for AMQP servers (currently only RabbitMQ).
Languages
Tools for interfacing with other languages - Official Website Resources.
Lua - a collaborative Hackage list.
- Fay - a proper subset of Haskell that compiles to JavaScript.
- Idris (⭐3.4k) - A Dependently Typed Functional Programming Language
- Copilot - a (Haskell DSL) stream language for generating hard real-time C code.
Operating Systems
Operating systems and systems programming - Official Website Resources.
Programming
Generic Programming - Official Website Resources.
Science
Mathematics & Physics - Official Website Resources.
Streaming Processing
- Conduit (⭐845) - a streaming data library. Resources.
- Pipes (⭐471) - is a clean and powerful stream processing library that lets you build and connect reusable streaming components. Resources.
Websites
- Try Haskell - Haskell Online.
Community
2. Awesome Perl
Database / DSP
Date & Time / NoSQL Databases
Email / NoSQL Databases
Logging / NoSQL Databases
ORM / NoSQL Databases
Package Management / NoSQL Databases
Protocol / NoSQL Databases
- Furl - Faster HTTP(S) Client
Web Frameworks / Coverage
3. Awesome Swift
Alert / Barcode
- SCLAlertView (⭐5.3k) - Animated Alert view.
4. Awesome Ruby
Database Tools
- Seed dump (⭐1.4k) - Rails 4 task to dump (parts) of your database to db/seeds.rb.
- Seed Fu (⭐1.2k) - Advanced seed data handling for Rails.
5. Awesome Android
Charts
- EazeGraph (⭐1.6k) - Chart and graph library.
GUI
- Flow (⭐2.8k) - Library that helps with describing an app as a collection of moderately independent screens.
GUI / Animations
- Android View Animations (⭐12k) - Cute view animation collection.
GUI / Images
- android-crop (⭐4.5k) - Library project for cropping images.
- CircularImageView (⭐1.2k) - Custom view for circular images while maintaining the best draw performance.
GUI / Loading Images
- Picasso (⭐18k) - A powerful image downloading and caching library for Android.
Networking / Field Validation
- OkHttp (⭐43k) - An HTTP+SPDY client for Android and Java applications.
- RoboSpice (⭐3k) - Library that makes writing asynchronous network requests easy.
Tracking / ORM
- Mixpanel - Analytics platform to analyze the users.
Utility / ORM
- EventBus - EventBus is a library that simplifies communication between different parts of your application.
- Otto (⭐5.2k) - Event Bus for Android.
Wireless / ORM
- SmartGattLib (⭐268) - Simplifies the work with Bluetooth SMART devices (a.k.a. Bluetooth Low Energy in Bluetooth 4.0).
Other / Custom Dialog
- Tape (⭐2.4k) - A lightning fast, transactional, file-based FIFO for Android and Java.
Resources / Custom Dialog
- Android Asset Studio - Generator for icons and other assets.
6. Awesome Html5
DOM Management / Web Components
Game development / WebRTC
Websites and resources / Twitter
Other awesome lists / Twitter
7. Awesome Groovy
Build tools, setup and CI
- Lazybones (⭐615) - A simple project creation tool that uses packaged project templates.
IDE and Editor Support
- IntelliJ IDEA - The Most Intelligent IDE for the Java Platform
- Groovy Web Console - The online Groovy console
- LightTable Plugin (⭐25) - LightTable Support
Web Frameworks
- Grails (⭐445) - A powerful web application framework based on the Groovy language
- Gaelyk (⭐220) - A lightweight Groovy toolkit for Google App Engine Java
- Glide (⭐53) - Create awesome apps on Google App Engine in a snap
- Ratpack (⭐1.9k) - A toolkit for JVM web applications
Database
- Gmongo (⭐182) - A Groovy wrapper to the mongodb Java driver
- Gstorm (⭐81) - A simple ORM for simple databases and CSV files to be used in groovy scripts
Rich Application
- GroovyFx - GroovyFX provides a Groovy binding for JavaFX 2.0.
Testing
- Spock (⭐3.4k) - The Enterprise-ready testing and specification framework.
- Geb (⭐1.1k) - Very Groovy Browser Automation
8. Awesome Nodejs
Packages / Command-line apps
- cpy (⭐426) - Copy files.
Packages / Filesystem
- del (⭐1.3k) - Delete files/folders using globs.
- globby (⭐2.5k) - Glob files with support for multiple patterns.
Packages / Real-time
- Primus (⭐4.5k) - An abstraction layer for real-time frameworks to prevent module lock-in.
Packages / Image
- sharp (⭐29k) - The fastest module for resizing JPEG, PNG, WebP and TIFF images.
- image-type (⭐371) - Detect the type of an image.
- gm (⭐6.9k) - GraphicsMagick and ImageMagick wrapper.
Packages / Text
- iconv-lite (⭐3k) - Convert character encodings.
- escape-string-regexp (⭐574) - Escape RegExp special characters.
- indent-string (⭐112) - Indent each line in a string.
- strip-indent (⭐134) - Strip leading whitespace from every line in a string.
Packages / Parsing
- URI.js (⭐6.3k) - URL mutation.
Packages / Humanize
- pretty-bytes (⭐1.1k) - Convert bytes to a human readable string:
1337→1.34 kB.
- pretty-ms (⭐1.1k) - Convert milliseconds to a human readable string:
1337000000→15d 11h 23m 20s.
- pretty-error (⭐1.5k) - Errors with less clutter.
Packages / Network
- get-port (⭐859) - Get an available port.
Packages / Node.js management
- nave (⭐1.6k) - Virtual Environments for Node.js.
Packages / Weird
- superb (⭐392) - Get superb like words.
- cool-ascii-faces (⭐1.8k) - Get some cool ascii faces.
Packages / Miscellaneous
- cheerio (⭐28k) - Fast, flexible, and lean implementation of core jQuery designed specifically for the server.
Resources / Tutorials
- The Art of Node (⭐9.8k) - An introduction to Node.js.
Resources / Videos
9. Awesome Php
Table of Contents / Dependency Management
- Pickle (⭐1.6k) - A PHP extension installer.
Table of Contents / Markup and CSS
- Cebe Markdown (⭐997) - A fast and extensible Markdown parser.
Table of Contents / Deployment
- Envoy (⭐1.6k) - A tool to run SSH tasks with PHP.
Configuration / PHP Books
- Securing PHP: Core Concepts - A book about common security terms and practices for PHP by Chris Cornutt.
10. Awesome Erlang
Release Management
- relx (⭐669) - A release assembler for Erlang.
Web Frameworks
- Axiom (⭐265) - A micro-framework, inspired by Ruby's Sinatra (⭐12k).
- ChicagoBoss (⭐1.8k) - A server framework inspired by Rails and written in Erlang.
Web Framework Components
- cb_admin (⭐67) - An admin interface for Chicago Boss.
HTTP
- lhttpc (⭐126) - A lightweight HTTP/1.1 client implemented in Erlang.
Testing
- PropEr (⭐838) - A QuickCheck-inspired property-based testing tool for Erlang.
Logging
- lager (⭐39) - A logging framework for Erlang/OTP.
- lager_hipchat (⭐7) - HipChat backend for lager.
- lager_loggly (⭐16) - Loggly backend for lager.
Code Analysis
- eflame (⭐401) - A Flame Graph profiler for Erlang.
Build Tools
- rebar (⭐940) - Erlang build tool that makes it easy to compile and test Erlang applications, port drivers and releases.
Actors
- poolboy (⭐1.5k) - A hunky Erlang worker pool factory.
Queue
- tinymq (⭐124) - A diminutive, in-memory message queue for Erlang.
Authentication
- oauth2 (⭐216) - Erlang Oauth2 implementation.
REST and API
- leptus (⭐354) - Leptus is an Erlang REST framework that runs on top of cowboy.
Third Party APIs
- restc (⭐86) - An Erlang REST client
- oauth2c (⭐71) - An Erlang oAuth 2 client (uses restc)
Algorithms and Datastructures
- erlando (⭐2) - A set of syntax extensions like currying and monads for Erlang.
- statebox (⭐244) - Erlang state "monad" with merge/conflict-resolution capabilities.
Books
- Learn You Some Erlang - Learn you some Erlang - for great good! A very thorough resource covering everything from beginning Erlang programming to large-scale development and deployment.
11. Awesome Devenv
Admins
- Robomongo - a cross platform Admin for MongoDB
Benchmarking
- phantomas (⭐2.2k) - website perf evaluation tool
Data
- s3cmd (⭐4k) - the S3 CLI tool for Amazon
Diagnostics
Desktop
- Alfred - OSX productivity app
/OSX/
- hydra (⭐5.2k) - script your desktop
/OSX/
- Keycastr (⭐463) - show your keys while
presenting/casting
/OSX/
Vim
- Powerline (⭐14k) - improved status bar for your buffers.
- snipmate (⭐2k) - textual snippets compatiable with Textmate snippets.
Sublime Text 3
- AdvancedNewFile (⭐817) - File creation plugin.
- jsFormat (⭐1.4k) - Javascript formatting.
- LiveReload - LiveReload plugin.
- MarkdownEditing (⭐3k) - Markdown syntax understanding and good color schemes.
- Package Control - The Sublime Text package manager.
- RubyTest (⭐729) - Plugin for running Ruby tests.
- Side Bar Enhancments (⭐2.1k) - Enhancements to Sublime Text sidebar. Files and folders.
- Sublime Git (⭐2.8k) - Git Integration for Sublime.
- Sublime Linter (⭐1.9k) - Interactive code linting.
- TrailingSpaces (⭐884) - Highlight trailing spaces and delete them in a flash.
Git / Extensions
- git-sweep (⭐2.3k) - safely removes branches that have been merged into the master
- hub - git CLI wrapper which makes working with GitHub easier
- scm_breeze (⭐2.6k) Streamline your git workflow
Presentation / Extensions
- remark (⭐12k) - markdown based presentation on your browser
- vimdeck (⭐1.4k) - present inside your Vim
Text / Extensions
- ack (⭐1.5k) - the Perl based better-than-grep tool.
- ag (⭐24k) - A C based code-searching tool similar to ack, but faster
- peco (⭐7.1k) - interactive filtering, like interactive Grep
Terminal / Extensions
- autojump (⭐14k) - remembers your
folders and jump to them based on partial recall (e.g.
j projwill jump to/home/Users/yourself/projects.
- httpie A command line HTTP client, a user-friendly cURL replacement.
- iTerm2 - a great terminal replacement
/OSX/
- oh-my-zsh (⭐151k) - the incredible ZSH addon.
Workflow / Extensions
- fswatch (⭐4.4k) - a watch tool which
will emit FS events and you can run commands on demand with. Note -
fswatch-runtoo.
- guard (⭐6.1k) - FS watch tool with a huge ecosystem of plugins
- watchman (⭐11k) - Facebook's better
watch- note it works as a service.
12. Awesome Clojure
Science and Data Analysis
Build Automation and Package management
Date and Time
Audio
Database
Redis
JSON
ORM and SQL generation
Security
RESTful API
HTML Manipulation
Data Validation
Async processing
Monads
WebSocket
Testing
Code Analysis and Linter
Text Processing
Websites / YouTube
Twitter / YouTube
13. Awesome Javascript
Testing Frameworks / Frameworks
- qunit (⭐4k) - An easy-to-use JavaScript Unit Testing framework.
Testing Frameworks / Coverage
- istanbul (⭐8.7k) - Yet another JS code coverage tool.
- JSCover (⭐395) - JSCover is a tool that measures code coverage for JavaScript programs.
Testing Frameworks / Runner
- phantomjs (⭐29k) - Scriptable Headless WebKit.
- slimerjs (⭐3k) - A PhantomJS-like tool running Gecko.
- zombie (⭐5.7k) - Insanely fast, full-stack, headless browser testing using node.js.
- totoro (⭐562) - A simple and stable cross-browser testing tool.
- karma (⭐12k) - Spectacular Test Runner for JavaScript.
MVC Frameworks and Libraries / Runner
- ember.js (⭐22k) - A JavaScript framework for creating ambitious web applications.
- knockout (⭐10k) - Knockout makes it easier to create rich, responsive UIs with JavaScript.
- spine (⭐3.7k) - Lightweight MVC library for building JavaScript applications.
Data Visualization / Runner
- paper.js (⭐14k) - The Swiss Army Knife of Vector Graphics Scripting – Scriptographer ported to JavaScript and the browser, using HTML5 Canvas.
Editors / Runner
- ace (⭐27k) - Ace (Ajax.org Cloud9 Editor).
- esprima (⭐409) - ECMAScript parsing infrastructure for multipurpose analysis.
- quill (⭐42k) - A cross browser rich text editor with an API.
- pen (⭐4.8k) - enjoy live editing (+markdown).
- jquery-notebook (⭐1.7k) - A simple, clean and elegant text editor. Inspired by the awesomeness of Medium.
- ckeditor-releases (⭐518) - The best web text editor for everyone.
- editor (⭐2.8k) - A markdown editor. still on development.
- EpicEditor (⭐4.3k) - An embeddable JavaScript Markdown editor with split fullscreen editing, live previewing, automatic draft saving, offline support, and more.
- jsoneditor (⭐11k) - A web-based tool to view, edit and format JSON.
Number / Runner
- accounting.js (⭐35) - A lightweight JavaScript library for number, money and currency formatting - fully localisable, zero dependencies.
Storage / Runner
- jStorage (⭐1.5k) - jStorage is a simple key/value database to store data on browser side.
- basket.js (⭐3.4k) - A script and resource loader for caching & loading scripts with localStorage.
- jquery-cookie (⭐8.6k) - A simple, lightweight jQuery plugin for reading, writing and deleting cookies.
- Cookies (⭐1.8k) - JavaScript Client-Side Cookie Manipulation Library.
Color / Runner
- colors (⭐9.3k) - Smarter defaults for colors on the web.
Control Flow / Runner
- async (⭐28k) - Async utilities for node and the browser.
Routing / Runner
- pathjs (⭐1.1k) - Simple, lightweight routing for web browsers.
- crossroads (⭐1.4k) - JavaScript Routes.
- davis.js (⭐532) - RESTful degradable JavaScript routing using pushState.
Validation / Runner
- jquery-validation (⭐10k) - jQuery Validation Plugin.
- validator.js (⭐23k) - String validation and sanitization.
- validate.js (⭐2.6k) - Lightweight JavaScript form validation library inspired by CodeIgniter.
Keyboard Wrappers / Runner
- KeyboardJS (⭐2.1k) - A JavaScript library for binding keyboard combos without the pain of key codes and key combo conflicts.
- jquery.hotkeys (⭐2.6k) - jQuery Hotkeys lets you watch for keyboard events anywhere in your code supporting almost any key combination.
- jwerty (⭐1.2k) - Awesome handling of keyboard events.
Tours And Guides / Runner
- bootstrap-tour (⭐4.4k) - Quick and easy product tours with Twitter Bootstrap Popovers.
- tourist (⭐1.2k) - Simple, flexible tours for your app.
- hopscotch (⭐4.2k) - A framework to make it easy for developers to add product tours to their pages.
- joyride (⭐1.4k) - jQuery feature tour plugin.
Notifications / Runner
- noty (⭐6.7k) - jQuery notification plugin.
- pnotify (⭐3.7k) - JavaScript notifications for Bootstrap, jQuery UI, and the Web Notifications Draft.
- humane-js (⭐2.1k) - A simple, modern, browser notification system.
Sliders / Runner
- FlexSlider (⭐4.9k) - An awesome, fully responsive jQuery slider plugin.
- sly (⭐2.9k) - JavaScript library for one-directional scrolling with item based navigation support.
- vegas (⭐1.8k) - A jQuery plugin to add beautiful fullscreen backgrounds to your webpages. It even allows Slideshows.
- Sequence (⭐3.4k) - CSS animation framework for creating responsive sliders, presentations, banners, and other step-based applications.
Form Widgets / Input
- tag-it (⭐2.5k) - A jQuery UI plugin to handle multi-tag fields as well as tag suggestions/autocomplete.
- Placeholders.js (⭐950) - A JavaScript polyfill for the HTML5 placeholder attribute.
- fancyInput (⭐1.9k) - Makes typing in input fields fun with CSS3 effects.
- jQuery-Tags-Input (⭐2.3k) - Magically convert a simple text input into a cool tag list with this jQuery plugin.
Form Widgets / Calendar
- pickadate.js (⭐7.7k) - The mobile-friendly, responsive, and lightweight jQuery date & time input picker.
- bootstrap-datepicker (⭐13k) - A datepicker for @twitter bootstrap forked from Stefan Petre's (of eyecon.ro), improvements by @eternicode.
- Pikaday (⭐8k) - A refreshing JavaScript Datepicker — lightweight, no dependencies, modular CSS.
Form Widgets / Select
- chosen (⭐22k) - A library for making long, unwieldy select boxes more friendly.
Form Widgets / File Uploader
- jQuery-File-Upload (⭐31k) - File Upload widget with multiple file selection, drag&drop support, progress bar, validation and preview images, audio and video for jQuery.
- flow.js (⭐3k) - A JavaScript library providing multiple simultaneous, stable, fault-tolerant and resumable/restartable file uploads via the HTML5 File API.
- plupload (⭐5.6k) - A JavaScript API for dealing with file uploads it supports features like multiple file selection, file type filtering, request chunking, client side image scaling and it uses different runtimes to achieve this such as HTML 5, Silverlight and Flash.
Form Widgets / Other
- Garlic.js (⭐2.4k) - Automatically persist your forms' text and select field values locally, until the form is submitted.
- Countable (⭐1.6k) - A JavaScript function to add live paragraph-, word- and character-counting to an HTML element.
- card (⭐12k) - Make your credit card form better in one line of code.
Tips / Other
- tipsy (⭐2k) - Facebook-style tooltips plugin for jQuery.
- qTip2 (⭐2k) - Pretty powerful tooltips.
- tooltipster (⭐2.8k) - A jQuery tooltip plugin.
- simptip (⭐647) - A simple CSS tooltip made with Sass.
Modals and Popups / Other
- Magnific-Popup (⭐11k) - Light and responsive lightbox script with focus on performance.
- jquery-popbox (⭐420) - jQuery PopBox UI Element.
- jquery.avgrund.js (⭐1.8k) - A jQuery plugin with new modal concept for popups.
- vex (⭐6.9k) - A modern dialog library which is highly configurable and easy to style.
- bootstrap-modal (⭐5k) - Extends the default Bootstrap Modal class. Responsive, stackable, ajax and more.
- css-modal (⭐1.8k) - A modal built out of pure CSS.
Maps / Other
- Leaflet (⭐41k) - JavaScript library for mobile-friendly interactive maps.
- gmaps (⭐7k) - The easiest way to use Google Maps.
- polymaps (⭐1.6k) - A free JavaScript library for making dynamic, interactive maps in modern web browsers.
- kartograph.js (⭐1.5k) - Open source JavaScript renderer for Kartograph SVG maps.
- mapbox.js (⭐1.9k) - Mapbox JavaScript API, a Leaflet Plugin.
- jqvmap (⭐1.8k) - jQuery Vector Map Library.
14. Awesome Bigdata
NewSQL Databases
- Haeinsa (⭐157) - linearly scalable multi-row, multi-table transaction library for HBase based on Percolator.
- Amazon RedShift - data warehouse service, based on PostgreSQL.
- H-Store - is an experimental main-memory, parallel database management system that is optimized for on-line transaction processing (OLTP) applications.
- InfiniSQL - infinity scalable RDBMS.
- MemSQL - in memory SQL database witho optimized columnar storage on flash.
- NuoDB - SQL/ACID compliant distributed database.
- Sky - database used for flexible, high performance analysis of behavioral data.
- SymmetricDS - open source software for both file and database synchronization.
Interesting Readings
- Big Data Benchmark - Benchmark of Redshift, Hive, Shark, Impala and Stiger/Tez.
Distributed Programming
- AMPLab SIMR - run Spark on Hadoop MapReduce v1.
- Apache Crunch - a simple Java API for tasks like joining and data aggregation that are tedious to implement on plain MapReduce.
- Apache Gora - framework for in-memory data model and persistence.
- Apache Hama - BSP (Bulk Synchronous Parallel) computing framework.
- Apache Pig - high level language to express data analysis programs for Hadoop.
- Apache Twill - abstraction over YARN that reduces the complexity of developing distributed applications.
- Cheetah - High Performance, Custom Data Warehouse on Top of MapReduce.
- Concurrent Cascading - framework for data management/analytics on Hadoop.
- Damballa Parkour (⭐258) - MapReduce library for Clojure.
- Datasalt Pangool (⭐57) - alternative MapReduce paradigm.
- Facebook Corona - Hadoop enhancement which removes single point of failure.
- Facebook Peregrine - Map Reduce framework.
- Facebook Scuba - distributed in-memory datastore.
- JAQL - declarative programming language for working with structured, semi-structured and unstructured data.
- Kite - is a set of libraries, tools, examples, and documentation focused on making it easier to build systems on top of the Hadoop ecosystem.
- Nokia Disco - MapReduce framework developed by Nokia.
- Stratosphere - general purpose cluster computing framework.
- Twitter Scalding (⭐3.4k) - Scala library for Map Reduce jobs, built on Cascading.
- Twitter Summingbird (⭐2.1k) - Streaming MapReduce with Scalding and Storm, by Twitter.
Distributed Filesystem
- Apache HDFS - a way to store large files across multiple machines.
- Ceph Filesystem - software storage platform designed.
- Facebook Haystack - object storage system.
Document Data Model
- Crate Data - is an open source massively scalable data store. It requires zero administration.
- jumboDB - document oriented datastore over Hadoop.
- MarkLogic - Schema-agnostic Enterprise NoSQL database technology.
Key-value Data Model
- ElephantDB (⭐553) - Distributed database specialized in exporting data from Hadoop.
- LinkedIn Krati (⭐26) - is a simple persistent data store with very low latency and high throughput.
- Linkedin Voldemort - distributed key/value storage system.
- Riak (⭐3.8k) - a decentralized datastore.
- Storehaus (⭐466) - library to work with asynchronous key value stores, by Twitter.
- Tarantool (⭐3.2k) - an efficient NoSQL database and a Lua application server.
Graph Data Model
- Apache Giraph - implementation of Pregel, based on Hadoop.
- Facebook TAO - TAO is the distributed data store that is widely used at facebook to store and serve the social graph.
- Google Pregel - graph processing framework.
- GraphX - resilient Distributed Graph System on Spark.
- Intel GraphBuilder - tools to construct large-scale graphs on top of Hadoop.
- Phoebus (⭐382) - framework for large scale graph processing.
- Titan - distributed graph database, built over Cassandra.
SQL-like processing
- Apache Hive - SQL-like data warehouse system for Hadoop.
- Datasalt Splout SQL - full SQL query engine for big datasets.
- Spark Catalyst (⭐36k) - is a Query Optimization Framework for Spark and Shark.
Data Ingestion
- Apache Flume - service to manage large amount of log data.
- Apache Kafka - distributed publish-subscribe messaging system.
- Apache Sqoop - tool to transfer data between Hadoop and a structured datastore.
- HIHO (⭐90) - framework for connecting disparate data sources with Hadoop.
- LinkedIn Kamikaze (⭐22) - utility package for compressing sorted integer arrays.
- Netflix Suro (⭐777) - log agregattor like Storm and Samza based on Chukwa.
- Pinterest Secor (⭐1.8k) - is a service implementing Kafka log persistance.
Service Programming
- Akka Toolkit - runtime for distributed, and fault tolerant event-driven applications on the JVM.
- Apache Avro - data serialization system.
- Apache Curator - Java libaries for Apache ZooKeeper.
- Apache Karaf - OSGi runtime that runs on top of any OSGi framework.
- Apache Thrift - framework to build binary protocols.
- Apache Zookeeper - centralized service for process management.
- Spring XD (⭐479) - distributed and extensible system for data ingestion, real time analytics, batch processing, and data export.
- Twitter Finagle - asynchronous network stack for the JVM.
Scheduling
- Sparrow (⭐314) - scheduling platform.
Machine Learning
- brain (⭐8k) - Neural networks in JavaScript.
- convnetjs (⭐11k) - Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.
- Decider (⭐386) - Flexible and Extensible Machine Learning in Ruby.
- etcML - text classification with machine learning.
- Etsy Conjecture (⭐358) - scalable Machine Learning in Scalding.
- MLbase - distributed machine learning libraries for the BDAS stack.
- MLPNeuralNet (⭐895) - Fast multilayer perceptron neural network library for iOS and Mac OS X.
- nupic (⭐6.3k) - Numenta Platform for Intelligent Computing: a brain-inspired machine intelligence platform, and biologically accurate neural network based on cortical learning algorithms.
- scikit-learn (⭐54k) - scikit-learn: machine learning in Python.
- Spark MLlib - a Spark implementation of some common machine learning (ML) functionality.
- Vowpal Wabbit (⭐8.2k) - learning system sponsored by Microsoft and Yahoo!.
- WEKA - suite of machine learning software.
Benchmarking
- Apache Hadoop Benchmarking - micro-benchmarks for testing Hadoop performances.
- Berkeley SWIM Benchmark (⭐126) - real-world big data workload benchmark.
- Intel HiBench (⭐1.4k) - a Hadoop benchmark suite.
Security
- Apache Knox Gateway - single point of secure access for Hadoop clusters.
System Deployment
- Apache Ambari - operational framework for Hadoop mangement.
- Apache Bigtop - system deployment framework for the Hadoop ecosystem.
- Apache Helix - cluster management framework.
- Apache Mesos - cluster manager.
- Apache Whirr - set of libraries for running cloud services.
- Buildoop - Similar to Apache BigTop based on Groovy language.
- Cloudera HUE - web application for interacting with Hadoop.
- Facebook Prism - multi datacenters replication system.
- Google Omega - job scheduling and monitoring system.
- Marathon (⭐4.1k) - Mesos framework for long-running services.
Applications
- Apache Nutch - open source web crawler.
- Apache Tika - content analysis toolkit.
- Eclipse BIRT - Eclipse-based reporting system.
- Eventhub (⭐1.3k) - open source event analytics platform.
- Snowplow (⭐6.5k) - enterprise-strength web and event analytics, powered by Hadoop, Kinesis, Redshift and Postgres.
- SparkR - R frontend for Spark.
Search engine and framework
- Apache Lucene - Search engine library.
- Apache Solr - Search platform for Apache Lucene.
- LinkedIn Bobo - is a Faceted Search implementation written purely in Java, an extension to Apache Lucene.
- LinkedIn Cleo (⭐558) - is a flexible software library for enabling rapid development of partial, out-of-order and real-time typeahead search.
- LinkedIn Zoie (⭐362) - is a realtime search/indexing system written in Java.
MySQL forks and evolutions
- Drizzle - evolution of MySQL 6.0.
- MariaDB - enhanced, drop-in replacement for MySQL.
- ProxySQL (⭐24) - High Performance Proxy for MySQL.
- WebScaleSQL - is a collaboration among engineers from several companies that face similar challenges in running MySQL at scale.
Memcached forks and evolutions
- Facebook McDipper - key/value cache for flash storage.
- Facebook Memcached - fork of Memcache.
- Twitter Fatcache (⭐1.3k) - key/value cache for flash storage.
- Twitter Twemcache (⭐930) - fork of Memcache.
Embedded Databases
- HanoiDB (⭐298) - Erlang LSM BTree Storage.
- RocksDB - embeddable persistent key-value store for fast storage based on LevelDB.
Business Intelligence
- Jaspersoft - powerful business intelligence suite.
- Microsoft - business intelligence software and platform.
- Pentaho - business intelligence platform.
Data Visualization
- Arbor (⭐2.6k) - graph visualization library using web workers and jQuery.
- Chart.js - open source HTML5 Charts visualizations.
- Cubism (⭐4.9k) - JavaScript library for time series visualization.
- Envisionjs (⭐1.6k) - dynamic HTML5 visualization.
- Matplotlib (⭐17k) - plotting with Python.
- NVD3 - chart components for d3.js.
- Recline (⭐2.1k) - simple but powerful library for building data applications in pure Javascript and HTML.
- Sigma.js (⭐11k) - JavaScript library dedicated to graph drawing.
2013 - 2014
- 2013 - AMPLab - Presto: Distributed Machine Learning and Graph Processing with Sparse Matrices.
- 2013 - AMPLab - MLbase: A Distributed Machine-learning System.
- 2013 - AMPLab - Shark: SQL and Rich Analytics at Scale.
- 2013 - AMPLab - GraphX: A Resilient Distributed Graph System on Spark.
- 2013 - Microsoft - Scalable Progressive Analytics on Big Data in the Cloud.
- 2013 - Metamarkets - Druid: A Real-time Analytical Data Store.
- 2013 - Google - Online, Asynchronous Schema Change in F1.
- 2013 - Google - MillWheel: Fault-Tolerant Stream Processing at Internet Scale.
- 2013 - Facebook - Scuba: Diving into Data at Facebook.
- 2013 - Facebook - Unicorn: A System for Searching the Social Graph.
- 2013 - Facebook - Scaling Memcache at Facebook.
2011 - 2012
- 2012 - AMPLab - Blink and It’s Done: Interactive Queries on Very Large Data.
- 2012 - AMPLab - Fast and Interactive Analytics over Hadoop Data with Spark.
- 2012 - AMPLab - Shark: Fast Data Analysis Using Coarse-grained Distributed Memory.
- 2012 - Microsoft - Paxos Replicated State Machines as the Basis of a High-Performance Data Store.
- 2012 - Microsoft - Paxos Made Parallel.
- 2012 - Google - Processing a trillion cells per mouse click.
- 2011 - AMPLab - Scarlett: Coping with Skewed Popularity Content in MapReduce Clusters.
- 2011 - AMPLab - Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center.
2001 - 2010
- 2010 - Facebook - Finding a needle in Haystack: Facebook’s photo storage.
- 2010 - AMPLab - Spark: Cluster Computing with Working Sets.
- 2010 - Google - Pregel: A System for Large-Scale Graph Processing.
- 2007 - Amazon - Dynamo: Amazon’s Highly Available Key-value Store.
- 2006 - Google - Bigtable: A Distributed Storage System for Structured Data.
15. Awesome D
Lexers, Parsers, Parser Generators / Bare metal / kernel development
- Martin Nowak's Lexer (⭐12) - A lexer generator.
- Goldie - Goldie Parsing System.
Web Frameworks / Bare metal / kernel development
- cmsed (⭐17) - A component library for Vibe that functions as a CMS.
Command Line / XML
- scriptlike (⭐90) - Utility library to aid writing script-like programs in D.
- todod (⭐15) - Todod is a command line based todo list manager. It also has support for shell interaction based on linenoise (⭐3.5k).
16. Awesome Hadoop
Hadoop
- Apache Hadoop - Apache Hadoop
- SpatialHadoop - SpatialHadoop is a MapReduce extension to Apache Hadoop designed specially to work with spatial data.
- GIS Tools for Hadoop - Big Data Spatial Analytics for the Hadoop Framework
- hadoopy (⭐243) - Python MapReduce library written in Cython.
- mrjob (⭐2.6k) - mrjob is a Python 2.5+ package that helps you write and run Hadoop Streaming jobs.
- pydoop - Pydoop is a package that provides a Python API for Hadoop.
- hdfs-du (⭐228) - HDFS-DU is an interactive visualization of the Hadoop distributed file system.
- White Elephant (⭐191) - Hadoop log aggregator and dashboard
NoSQL
- Apache HBase - Apache HBase
- happybase (⭐595) - A developer-friendly Python library to interact with Apache HBase.
- Hannibal (⭐170) - Hannibal is tool to help monitor and maintain HBase-Clusters that are configured for manual splitting.
- hindex (⭐588) - Secondary Index for HBase
Workflow, Lifecycle and Governance
Data Ingestion and Integration
- Apache Flume - Apache Flume
DSL
- Apache Pig - Apache Pig
- Apache DataFu - A collection of libraries for working with large-scale data in Hadoop
- packetpig (⭐301) - Open Source Big Data Security Analytics
- akela (⭐76) - Mozilla's utility library for Hadoop, HBase, Pig, etc.
- seqpig - Simple and scalable scripting for large sequencing data set(ex: bioinfomation) in Hadoop
- Lipstick (⭐460) - Pig workflow visualization tool. Introducing Lipstick on A(pache) Pig
Libraries and Tools
- Kite Software Development Kit - A set of libraries, tools, examples, and documentation
- gohadoop (⭐307) - Native go clients for Apache Hadoop YARN.
Packaging, Provisioning and Monitoring
- Apache Bigtop - Apache Bigtop: Packaging and tests of the Apache Hadoop ecosystem
Benchmark
Websites
17. Awesome Shell
Customization / Directory Navigation
- bash-powerline (⭐874) - Powerline-style Bash prompt in pure Bash script
- bashstrap (⭐1.6k) - A quick way to spruce up OSX terminal
- liquidprompt (⭐4.4k) - A full-featured & carefully designed adaptive prompt for Bash & Zsh
Multimedia and File Formats / Directory Navigation
- PiCAST (⭐1.7k) - PiCAST turns your $35 Raspberry Pi in to a Chromecast like Device
Games / Directory Navigation
- bash2048 (⭐885) - Bash implementation of 2048 game
18. Tools
Placeholder
19. Awesome Python
HTML Manipulation
- untangle (⭐609) - Converts XML documents to Python objects for easy access.
- Prev: Jul 21 - Jul 27, 2014
- Next: Jul 07 - Jul 13, 2014