Awesome List Updates on Dec 31, 2018
6 awesome lists updated today.
🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor
1. Awesome Deep Learning Resources
Posts and Articles
- The Annotated Transformer - Good for understanding the "Attention Is All You Need" (AIAYN) paper.
- The Illustrated Transformer - Also good for understanding the "Attention Is All You Need" (AIAYN) paper.
- Improving Language Understanding with Unsupervised Learning - SOTA across many NLP tasks from unsupervised pretraining on huge corpus.
- NLP's ImageNet moment has arrived - All hail NLP's ImageNet moment.
- The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) - Understand the different approaches used for NLP's ImageNet moment.
Practical Resources / Librairies and Implementations
- Self Governing Neural Networks (SGNN): the Projection Layer (⭐22) - With this, you can use words in your deep learning models without training nor loading embeddings.
Practical Resources / Some Datasets
- SentEval: An Evaluation Toolkit for Universal Sentence Representations - A Python framework to benchmark your sentence representations on many datasets (NLP tasks).
- ParlAI: A Dialog Research Software Platform - Another Python framework to benchmark your sentence representations on many datasets (NLP tasks).
Papers / Attention Mechanisms
- Attention Is All You Need (AIAYN) - Introducing multi-head self-attention neural networks with positional encoding to do sentence-level NLP without any RNN nor CNN - this paper is a must-read (also see this explanation and this visualization of the paper).
Papers / Other
- ProjectionNet: Learning Efficient On-Device Deep Networks Using Neural Projections - Replace word embeddings by word projections in your deep neural networks, which doesn't require a pre-extracted dictionnary nor storing embedding matrices.
- Self-Governing Neural Networks for On-Device Short Text Classification - This paper is the sequel to the ProjectionNet just above. The SGNN is elaborated on the ProjectionNet, and the optimizations are detailed more in-depth (also see my attempt to reproduce the paper in code (⭐22) and watch the talks' recording).
- Matching Networks for One Shot Learning - Classify a new example from a list of other examples (without definitive categories) and with low-data per classification task, but lots of data for lots of similar classification tasks - it seems better than siamese networks. To sum up: with Matching Networks, you can optimize directly for a cosine similarity between examples (like a self-attention product would match) which is passed to the softmax directly. I guess that Matching Networks could probably be used as with negative-sampling softmax training in word2vec's CBOW or Skip-gram without having to do any context embedding lookups.
2. Awesome Dotnet Core
Frameworks, Libraries and Tools / Application Frameworks
- Prism (⭐6.2k) - Prism is a framework for building loosely coupled, maintainable, and testable XAML applications in WPF, Windows 10 UWP, and Xamarin Forms.
Articles / Workflow
- InfoQ .NET articles - Collection of best .NET articles on InfoQ site
3. Awesome Web Security
Offensive / Cross Site Request Forgery
- XSRFProbe (⭐790) - The Prime CSRF Audit & Exploitation Toolkit by @0xInfection.
4. Awesome Cpp
Scripting
- AngelScript - AngelScript is a game-oriented interpreted/compiled scripting language. [zlib]
5. Awesome CoreML Models
Image - Metadata/Text
- PhotoAssessment - Photo Assessment using Core ML and Metal. Download (⭐60) | Demo (⭐60) | Reference
- PoseEstimation - Estimating human pose from a picture for mobile. Download (⭐969) | Demo (⭐649) | Reference (⭐969)
- RN1015k500 - Predict the location where a picture was taken. Download | Demo (⭐54) | Reference
- Nudity - Classifies an image either as NSFW (nude) or SFW (not nude) Download | Demo (⭐103) | Reference (⭐5.7k)
Image - Image
- HED - Detect nested edges from a color image. Download (⭐103) | Demo (⭐103) | Reference
- AnimeScale2x - Process a bicubic-scaled anime-style artwork Download (⭐510) | Demo (⭐510) | Reference
Text - Metadata/Text
- DocumentClassification - Classify news articles into 1 of 5 categories. Download (⭐43) | Demo (⭐43) | Reference (⭐43)
- NamesDT - Gender Classification using DecisionTreeClassifier Download (⭐34) | Demo (⭐34) | Reference
Miscellaneous
- Exermote - Predicts the exercise, when iPhone is worn on right upper arm. Download (⭐123) | Demo (⭐123) | Reference
- TensorFlow Slim Models (⭐76k) - Another collection of TensorFlow Models.
- MXNet Model Zoo - Collection of MXNet models.
- LaMem (⭐17) Score the memorability of pictures.
- ILGnet (⭐106) The aesthetic evaluation of images.
- Colorization (⭐3.2k) Automatic colorization using deep neural networks.
- Illustration2Vec (⭐667) Estimating a set of tags and extracting semantic feature vectors from given illustrations.
- CTPN (⭐1.3k) Detecting text in natural image.
- Image Analogy (⭐1.4k) Find semantically-meaningful dense correspondences between two input images.
- iLID (⭐86) Automatic spoken language identification.
- Fashion Detection (⭐462) Cloth detection from images.
- Saliency (⭐183) The prediction of salient areas in images has been traditionally addressed with hand-crafted features.
- Face Detection (⭐23) Detect face from image.
- mtcnn (⭐498) Joint Face Detection and Alignment.
- deephorizon (⭐35) Single image horizon line estimation.
6. Awesome Interview Questions
Programming Languages/Frameworks/Platforms / Objective-C
OS / Linux
Blockchain / Windows
- Prev: Jan 01, 2019
- Next: Dec 30, 2018