ML News Monthly – Mar 2021

Welcome to the sixth edition of ML News Monthly – Mar 2021!!

Here are the key happenings this month in the Machine Learning field that I think are worth knowing about. 🕸


Turing Award goes to researchers who made programming easier and more powerful

Alfred Aho and Jeffrey Ullman win the 2020 Turing Award for pioneering compiler and algorithm work.

https://www.cnet.com/news/turing-award-goes-to-researchers-who-made-programming-easier-and-more-powerful/

COVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image Prediction

Anuroop Sriram, Matthew Muckley, and colleagues at Facebook, NYU School of Medicine, and NYU Abu Dhabi developed a system that examines X-ray images to predict which Covid-19 patients are at greatest risk of decline.

https://arxiv.org/abs/2101.04909

Brain2Pix: Fully convolutional naturalistic video reconstruction from brain activity

What brain sees ?

Lynn Le, Luca Ambrogioni, and colleagues at Radboud University and Max Planck Institute for Human and Brain Cognitive Sciences developed Brain2Pix, a system that reconstructs what people saw from scans of their brain activity.

https://www.biorxiv.org/content/10.1101/2021.02.02.429430v1

Could The Simpsons replace its voice actors with AI deepfakes?

https://www.wired.co.uk/article/simpsons-deepfake-voice-actors-ai

Scientists developed a clever way to detect Deepfakes by analyzing light reflections in the eyes

https://thenextweb.com/neural/2021/03/11/ai-detects-deepfakes-analyzing-light-reflections-in-the-cornea-eyes-gans-thispersondoesnotexist/

Natural Language Processing Named a Foundational AI Technology, According to the 2021 AI in Healthcare Survey Report

https://www.globenewswire.com/news-release/2021/03/29/2200996/0/en/Natural-Language-Processing-Named-a-Foundational-AI-Technology-According-to-the-2021-AI-in-Healthcare-Survey-Report.html

An AI is training counselors to deal with teens in crisis

The Trevor Project, a nonprofit organization that operates a 24-hour hotline for LGBTQ youth, uses a “crisis contact simulator” to train its staff in how to talk with troubled teenagers

https://www.technologyreview.com/2021/02/26/1020010/trevor-project-ai-suicide-hotline-training/

Away From Silicon Valley, the Military Is the Ideal Customer

As large tech companies have backed away from defense work, startups like Anduril, Shield AI, and Teal are picking up the slack. They’re developing autonomous fliers specifically for military operations.

THE AI INDEX REPORT : Measuring trends in Artificial Intelligence by Stanford

Researchers at the Stanford Institute for Human-Centered Artificial Intelligence compiled AI Index 2021 by analyzing academic research, investment reports, and other data sources.

Can Auditing Eliminate Bias from Algorithms?

https://themarkup.org/ask-the-markup/2021/02/23/can-auditing-eliminate-bias-from-algorithms

Expert.ai Extends Entity Identification Capabilities to Personal Identifiable Information (PII) via NL API

The languages that defy auto-translate

https://www.bbc.com/future/article/20210322-the-languages-that-defy-auto-translate

FAANG / GAFAM / FANGAM / BATX


Google Overhauls Ethical AI Team

Marian Croak, an accomplished software engineer and vice president of engineering at Google, will lead a new center of expertise in responsible AI. The move came after the exits of her predecessors Timnit Gebru and Margaret Mitchell.

https://blog.google/technology/ai/marian-croak-responsible-ai/

How Facebook got addicted to spreading misinformation

The company’s AI algorithms gave it an insatiable habit for lies and hate speech. Now the man who built them can’t fix the problem.

https://www.technologyreview.com/2021/03/11/1020600/facebook-responsible-ai-misinformation/

Google’s new experimental app can scan and categorize your documents

Google has developed an experimental app called Stack, which scans and categorises your documents.

https://www.engadget.com/stack-area-120-173647210.html

Amazon introduces choreographed motions with Alexa Presentation Language 1.6

Amazon has unveiled a new version of its Alexa Presentation Language (APL)—apparently APL-based multimodal apps are seeing more than 3x the number of monthly active users compared with voice-only apps.

Google’s AI reservation service Duplex is now available in 49 states

The Duplex reservation service is now available in 49 US states—apparently Louisiana has local laws that rule it out for the moment

https://www.theverge.com/2021/4/1/22361729/google-duplex-ai-reservation-availability-49-us-states

The science behind semantic search: How AI from Bing is powering Azure Cognitive Search

https://www.microsoft.com/en-us/research/blog/the-science-behind-semantic-search-how-ai-from-bing-is-powering-azure-cognitive-search/

New Fiat 500 ‘Hey Google’ Edition Brands Car as Google Assistant on Wheels

Fiat has partnered with Google to release a ‘Hey Google’ version of the Fiat 500 that is integrated deeply with Google Assistant

Constructing Transformers For Longer Sequences with Sparse Attention Methods

https://ai.googleblog.com/2021/03/constructing-transformers-for-longer.html?m=1

Papers


MODEL ASSERTIONS FOR MONITORING AND IMPROVING ML MODELS

ML models are increasingly deployed in settings with real world interactions such as vehicles, but unfortunately, these models can fail in systematic ways. To prevent errors, ML engineering teams monitor and continuously improve these models. Authors propose a new abstraction, model assertions, that adapts the classical use of program assertions as a way to monitor and improve ML models.

https://arxiv.org/pdf/2003.01668.pdf

Graph Neural Networks Including Sparse Interpretability

https://arxiv.org/abs/2007.00119

Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactuals

There has been a recent resurgence of interest in explainable artificial intelligence (XAI) that aims to reduce the opaqueness of AI-based decision-making systems, allowing humans to scrutinize and trust them. In this paper, Authors propose a principled causality-based approach for explaining black-box decision-making systems that addresses limitations of existing methods in XAI.

https://arxiv.org/abs/2103.11972

Google Open-Sources AutoML Algorithm Model Search

https://www.infoq.com/news/2021/03/google-model-search/

Finetuning Pretrained Transformers into RNNs

https://arxiv.org/abs/2103.13076

Local Interpretations for Explainable Natural Language Processing: A Survey

https://arxiv.org/pdf/2103.11072.pdf

Hurdles to Progress in Long-form Question Answering

https://arxiv.org/abs/2103.06332

Understanding Robustness of Transformers for Image Classification

https://arxiv.org/abs/2103.14586

Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges

https://arxiv.org/abs/2103.11251v1

Rethinking Spatial Dimensions of Vision Transformers

https://arxiv.org/abs/2103.16302

A Neighbourhood Framework for Resource-Lean Content Flagging

Authors propose a novel interpretable framework for cross-lingual content flagging, which outperforms prior work both in terms of predictive performance and average inference time.

https://arxiv.org/abs/2103.17055

Courses / Resources


How to break a model in 20 days. A tutorial on production model analytics.

https://evidentlyai.com/blog/tutorial-1-model-analytics-in-production

How I Would Explain GANs From Scratch to a 5-Year Old: Part 1

https://www-topbots-com.cdn.ampproject.org/c/s/www.topbots.com/explain-gans-from-scratch-part1/

Performance comparison: counting words in Python, Go, C++, C, AWK, Forth, and Rust

https://benhoyt.com/writings/count-words/

Can Language Models Be Too Big? 🦜with Emily Bender and Margaret Mitchell

Worldwide Non-pharmaceutical Interventions Tracker for COVID-19(WNTRAC)

https://ibm.github.io/wntrac/

Accessible Multi-Billion Parameter Model Training with PyTorch Lightning + DeepSpeed

https://medium.com/pytorch-lightning/accessible-multi-billion-parameter-model-training-with-pytorch-lightning-deepspeed-c9333ac3bb59

Introducing PyTorch Profiler – the new and improved performance tool

https://pytorch.org/blog/introducing-pytorch-profiler-the-new-and-improved-performance-tool/

Using NLP to extract quick and valuable insights from your customers’ reviews

https://medium.com/artefact-engineering-and-data-science/customer-reviews-use-nlp-to-gain-insights-from-your-data-4629519b518e

AutoNLP by Hugging Face

https://github.com/huggingface/autonlp


That’s it !!

Let me know if I missed anything or if there’s anything you think should be included in a future post.