Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon

Facebook releases Pythia, a deep learning framework for vision and language multimodal research

Save for later
  • 2 min read
  • 22 May 2019

article-image
Yesterday, the team at Facebook released Pythia, a deep learning framework that supports multitasking in the vision and language multimodal research. Pythia is built on the open-source PyTorch framework and enables researchers to easily build, reproduce, and benchmark AI models.

https://twitter.com/facebookai/status/1130888764945907712

It is designed for vision and language tasks, such as answering questions that are related to visual data and automatically generates image captions. This framework also incorporates elements of Facebook’s winning entries in recent AI competitions including the VQA Challenge 2018 and Vizwiz Challenge 2018.

Features of Pythia

  • Reference implementations: Pythia references implementations to show how previous state-of-the-art models achieved related benchmark results.
  • Performance gauging: It also helps in gauging the performance of new models.
  • Multitasking: Pythia supports multitasking and distributed training.
  • Datasets: It also includes support for various datasets built-in including VizWiz, VQA,TextVQA and VisualDialog.
  • Unlock access to the largest independent learning library in Tech for FREE!
    Get unlimited access to 7500+ expert-authored eBooks and video courses covering every tech area you can think of.
    Renews at AU $24.99/month. Cancel anytime
  • Customization: Pythia features custom losses, metrics, scheduling, optimizers, tensorboard as per the needs of the customers.
  • Unopinionated: Pythia is unopinionated about the dataset and model implementations that are built on top of it.


The goal of the team behind Pythia is to accelerate the AI models and their results and further make it easier for the AI community to build on, and benchmark against, successful systems.

The team hopes that Pythia will also help researchers to develop adaptive AI that synthesizes multiple kinds of understanding into a more context-based, multimodal understanding. The team also plans to continue adding tools, data sets, tasks, and reference models.

To know more about this news, check out the official Facebook announcement.

Facebook tightens rules around live streaming in response to the Christchurch terror attack

Facebook again, caught tracking Stack Overflow user activity and data

Facebook bans six toxic extremist accounts and a conspiracy theory organization