Chatbots for Developers Training Course

Duration

14 hours (usually 2 days including breaks)

Requirements

  • Knowledge of application development and programming languages
  • Understanding of artificial intelligence (AI) and natural language processing (NLP) concepts

Audience

  • Developers

Overview

Chatbots (also called chatterbots or conversational agents) are software applications that use artificial intelligence (AI) to interact and communicate with users via text, voice, or text-to-speech. Chatbots enable businesses to provide an automated service for customers, employees, and site visitors at a minimum cost.

This instructor-led, live training (online or onsite) is aimed at developers who wish to install, set up, and manage chatbot-building platforms and code-based frameworks to create and deploy chatbot services.

By the end of this training, participants will be able to design, build, evaluate, and test chatbot services to provide automated chat or voice support interfaces for their users.

Format of the Course

  • Interactive lecture and discussion.
  • Lots of exercises and practice.
  • Hands-on implementation in a live-lab environment.

Course Customization Options

  • To request a customized training for this course, please contact us to arrange.

Course Outline

Introduction

Overview of Chatbots and Artificial Intelligence (AI)

Understanding Chatbot Architecture and Natural Language Processing (NLP)

Exploring Applications for Chatbots and Chatbot Types

Understanding Customer Goals and Needs

Designing Chatbot Scripts and Flow

Building Chatbots Using Code-Based Frameworks

Exploring Existing Platforms for Building Chatbots

Setting Up a Developer Environment for Chatbots

Working with Training Data for NPL Models

Pre-Processing Incoming Data

Designing a Text Classifier Model

Working with Entities, Intents, and Contexts

Working with Server Integration and Data Syncing

Creating a Simple Text-Based Chatbot

Creating a Simple Voice-Based Chatbot

Using Speech Recognition Technology

Evaluating and Testing Chatbots

Troubleshooting

Summary and Conclusion

Building Chatbots in Python Training Course

Duration

21 hours (usually 3 days including breaks)

Requirements

  • Python programming experience

Overview

ChatBots are computer programs that automatically simulate human responses via chat interfaces. ChatBots help organizations maximize their operations efficiency by providing easier and faster options for their user interactions.

In this instructor-led, live training, participants will learn how to build chatbots in Python.

By the end of this training, participants will be able to:

  • Understand the fundamentals of building chatbots
  • Build, test, deploy, and troubleshoot various chatbots using Python

Audience

  • Developers

Format of the course

  • Part lecture, part discussion, exercises and heavy hands-on practice

Note

  • To request a customized training for this course, please contact us to arrange.

Course Outline

Introduction to ChatBots

Overview of Conversational Software

Building Your First Basic ChatBot

  • Setting Up Your ChatBot to Receive Text and Respond to Users
  • Adding the Basic Elements of Personality
  • Teaching Your ChatBot to Answer Basic Questions
  • Adding Variety to Your ChatBot’s Responses
  • Making Your ChatBot Ask Questions
  • Building Rule-Based Systems for Parsing Text

Using Machine Learning to Turn Natural Language into Structured Data for Your ChatBot

  • Overview of SpaCy, Scikit-learn, and Rasa NLU
  • Installing and Configuring SpaCy, Scikit-learn, and Rasa NLU
  • Intents and Entities and their Classifications
  • Natural Language Processing Fundamentals Theory Refresher
  • Building Models from Real-World Sentences Using the ATIS Dataset

Building Your Virtual Assistant ChatBot

  • Overview of a Virtual Assistant
  • Working with SQL in Python
  • Teaching Your ChatBot to Access Data from a Database
  • Writing Queries from Parameters
  • Building a Database from Natural Language
  • Implementing Custom Virtual Assistant Features on Your ChatBot
    • Answering Specific Queries through Database Access
    • Refining Search, Performing Basic Negation, and Filtering Data

Making Your ChatBot Stateful: Keeping Track of States of Interaction for Better ChatBot Dialogs

  • Performing Basic Actions
  • Asking Contextual Questions and Queuing Answers
  • Dealing with Rejection

Testing and Deploying Your ChatBot

Troubleshooting

Summary and Conclusion

Building a Facebook Chatbot in Chatfuel

Respond to users with Artificial Intelligence

Set up behavioral retargeting to drive sales

Add up-sells to your e-commerce bot

Automatically migrate user data to MailChimp & Google Sheets

Analyze bot trends to improve conversion rates

Grow your reachable users with Facebook Ads

Use JSON plugins to expand functionality

Hide Chatfuel branding

Transfer ownership of a bot to a client without their password

Personalize your messages with predefined user data

Onboard new users quickly

Add GIFs and emojis to your bot

Integrate native audio & video to your bot

Requirements

  • Google Sheets
  • MailChimp
  • Photoshop
  • Facebook Ads
  • Facebook Messenger

Description

Facebook Messenger chatbots will be the next BIG marketing trend in 2017 and beyond.

More than 1 billion people are active on Messenger every month, so why not monetize this platform as part of your/your client’s social media marketing strategy?

The beauty is that chatbots are still in their infancy, meaning that very few businesses are using them to sell. This equates to HUGE opportunity for you, as a digital marketer, because deploying a bot will help your brand — and whatever products you’re selling — stand out from the competition.

Some advantages of building Facebook bots include…

  • 90% open rates, compared to the average 30% with email marketing
  • Instant, relevant answers to users who message your page, eliminating slow responses and missed sales
  • Reach all your fans without paying Facebook to “boost” your posts
  • Personalize your sales pitches using Facebook data, proving to customers that you understand them
  • Monetize your conversations inside Messenger without redirecting them to a painfully slow sales page

Whether you’re a brand consultant, social media marketing agency, or a do-it-yourself small business owner, this course will teach you how to build a Facebook Messenger bot that converts users and puts money in the bank.

Who this course is for:

  • Social media marketers
  • Branding consultants
  • “DIY” business owners

Course content

Chatbot Design: Create Chatbots from A to Z with No Coding

Build a complete chatbot without coding

Choose the proper channels for your chatbot

Use the design thinking method in the chatbot creation process

Use Chat Widget to set up and install a chatbot on your website

Create user-friendly welcome messages and fallback messages

Gather and process user data with the ChatBot app

Collect and analyze user inputs in the ChatBot app

Monitor and improve chats with Reports

Requirements

  • No programming experience needed. You’re going to use a no-code tool.
  • You’ll need a free ChatBot trial for the practical part.

Description

Welcome to the No-code Chatbot Design Course!

This free course will teach you how to design and build AI customer service chatbots from scratch, regardless of your technical background. The course takes you through every step of the chatbot creation process, from conceptualization to deployment, using the no-code ChatBot platform.

The ChatBot experts will walk you through the subject of chatbots from theory to work in practice with the ChatBot app. The course consists of 5 introductory lectures and 14 practical tutorials.

In Part 1, you’ll be introduced to the concept of chatbots and their business applications. In Part 2, you’ll start building your chatbot and learn how to install it on your website or other communication channels like Facebook Messenger, Slack, LiveChat, and more.

You’ll need to create a ChatBot trial account to build and launch your chatbot.


Why chatbot design?

Chatbots are becoming increasingly popular in many industries, including customer service, healthcare, finance, and education. As businesses and organizations continue to adopt chatbots to interact with customers and clients, the demand for chatbot designers has increased.

A chatbot designer is responsible for designing, developing, and implementing chatbots that can effectively communicate with users, understand their needs, and provide relevant information or services. No-code platforms let you become a chatbot expert without a programming background or advanced technical skills.

Chatbot design can be a standalone job in larger organizations and an important skill set for managers and specialists in customer service, marketing, or sales.


Course breakdow


PART 1 – Introduction to chatbots


1 – What are chatbots, and how do they work?

  • What is a chatbot?
  • What is the difference between a bot and a chatbot?
  • What is the difference between rule-based chatbots and AI chatbots?
  • What are common chatbot use cases?

2 – How can you create a chatbot? Coding vs. no coding

  • What are common ways to create a chatbot?
  • How to build a chatbot from scratch – methods comparison
  • How can you build a bot without coding?

3 – Design thinking – How to use it to create better chatbots

  • Design thinking definition
  • Stages of the design thinking process
  • How can you use design thinking during chatbot implementation?

4 – Chatbot channels: website, LiveChat, Facebook Messenger, WhatsApp

  • What is the customer communication channel?
  • Different channels for chatbots – Pros and cons
  • How to choose the right channel for your chatbot

5 – Welcome message – Engage the user from the first interaction

  • Chatbot welcome message definition
  • The importance of the chatbot welcome message
  • Best practices for creating chatbot welcome messages

PART 2 – Building chatbots – Practical tutorials with the ChatBot app


6 – ChatBot app tour – Dashboard overview

  • ChatBot Visual Builder
  • ChatBot Story
  • Testing Tool
  • Adding a chatbot to channels using integrations

7 – How to set up a welcome message in ChatBot

  • Welcome message
  • Bot response interaction
  • Types of Bot responses
  • Buttons in Bot responses

8 – How to collect user input in ChatBot

  • User input block
  • Matching systems

9 – Communication for errors – Create fallback messages in ChatBot

  • Fallback interaction
  • Contextual fallback
  • Fallback configuration

10 – Data collection – Gather and process user data with ChatBot

  • Question action
  • Attributes
  • Entities

11 – Chatbot personalization

  • Filters
  • Personalized bot replies with attributes

12 – Testing Tool in ChatBot

  • Testing Tool
  • Debug mode

13 – Chatbot installation – add a chatbot on your website

  • Chat Widget overview
  • Chat Widget customization
  • Testing chatbot on a sample page
  • Adding a chatbot to the website

14 – Chatbot analytics – Ways to monitor your chats

  • Training tool
  • Archives
  • Reports

Who this course is for:

  • Business owners
  • Learners interested in AI and chatbot design topics
  • Customer support, marketing, and sales managers or specialists
  • Agencies or consulting businesses working in the field of sales, marketing, and customer service

Course content

How to Create Chatbots Without Coding – Complete Course

Understand key concepts to set up your own Conversational AI using the Cognigy.AI platform. No coding knowledge required

Requirements

  • Basic comfort with web-based tools.
  • Chrome Browser installed.
  • Some Javascript knowledge useful but not required.

Description

***NEW Course Available for Cognigy.AI v4***

Visit Cognigy Academy for the latest training resources. Cognigy’s training courses cover topics from conversational design to advanced flow development.

Cognigy AI is the artificial intelligence and dialog management engine that automates interactions between customers and the systems and data they need to access. The Cognigy platform automates conversations across chat and voice channels, providing a natural-language interface for customers and employees to access information and accomplish tasks without the immediate need for human agents.

What can you build with Cognigy?

  • Chatbots on your website can capture information about users and provide them with personalized information through a conversational interface.
  • Automated conversations on channels like Facebook Messenger or WhatsApp allow companies to scale their presence on social channels, providing engagement, personalized interactions and consistent messaging wherever users are in a dialog with your brand.
  • Conversational commerce creates an automated connection with users to educate them about products, assist with transactions and guide them through the commerce funnel.

Understanding key concepts and how to apply them through the Cognigy.AI platform will help you bring Conversational AI to your organization. Learn about Flows, Lexicons, Intents, Conversational Forms, Profiles and Analytics. Practice basic editing and configuration activities using the Cognigy user interface. Deploy your creation on any channel(s) of your users’ preference.

Each section includes a conceptual overview of the topic as well as a demonstration of how to use the Cognigy.AI software.

Who this course is for:

  • End users of the Cognigy software who will perform basic editing of flows, lexicons and forms.

Show less

Course content

6 sections • 11 lectures • 41m total length

How to build smart chatbots on GPT-3 based conversational AI

In this course you will learn how to build Conversational AI chatbots using webapi-ai platform

Requirements

  • No prerequisite is required

Description

By the end of this practice course you will be able to:

  • Examine the traditional chatbot’s functionality;
  • Identify the advantages of a new generation GPT-3 AI chatbot;
  • Learn and practice the webapi ai service chatbot builder;
  • Utilize ready-to-use templates;
  • Integrate the channels of communications into your chatbot builder

Overview:

Traditional chatbot services have limited responses, are non-adaptive, difficult to build, and more importantly, overwhelm the user with tons of unnecessary questions. This is why, many companies are reluctant to use the bulky conventional chatbot services, and clients are frustrated with bots and eager to switch to a ‘human’ support manager. In contrast, we humans don’t need access to thousands of examples to master a skill like a customer service. In most cases, familiarity with the subject matter, a guideline set, and some sample dialogue that is all needed.

Think of an AI chatbot builder as if it were your new employee. You can give free-form instructions and provide sample dialogue scenarios to teach an AI chatbot builder. Moreover, the domain knowledge may include some simple instructions, FAQ database, and can communicate with your API for sending and retrieving information such as unique order details, customer’s payment information, and many more.

You will also learn how to integrate your systems through APIs so that the chatbot will be able to perform: bookings, account management, change order details, ticket cancelation, and many more.

You will practice the built-in integrations with popular services such as Zendesk, Shopify, Calendly, Stripe, and many more.

Who this course is for:

  • IT specialists
  • freelancers
  • marketing specialists
  • customer support manager

Course content

2 sections • 9 lectures • 47m total length

Machine Learning: 6 Real-World Examples

Machine learning is a modern innovation that has enhanced many industrial and professional processes as well as our daily lives. It’s a subset of artificial intelligence (AI), which focuses on using statistical techniques to build intelligent computer systems to learn from available databases. 

With machine learning, computer systems can take all the customer data and utilise it. It operates on what’s been programmed while also adjusting to new conditions or changes. Algorithms adapt to data, developing behaviours that were not programmed in advance.

Learning to read and recognise context means a digital assistant could scan emails and extract the essential information. Inherent in this learning is the ability to make predictions about future customer behaviours. This helps you understand your customers more intimately and not just be responsive, but proactive.

Deep learning is a segment of machine learning. In essence, it’s an artificial neural network with three or more layers. Neural networks with only one layer can make estimated predictions. The addition of more layers can assist with increasing optimisation and accuracy. 

Machine learning is relevant in many fields, industries, and has the capability to grow over time. Here are six real-life examples of how machine learning is being used.

1. Image recognition

Image recognition is a well-known and widespread example of machine learning in the real world. It can identify an object as a digital image, based on the intensity of the pixels in black and white images or colour images.
 

Real-world examples of image recognition:

  • Label an x-ray as cancerous or not
  • Assign a name to a photographed face (aka “tagging” on social media)
  • Recognise handwriting by segmenting a single letter into smaller images

Machine learning is also frequently used for facial recognition within an image. Using a database of people, the system can identify commonalities and match them to faces. This is often used in law enforcement.

2. Speech recognition

Machine learning can translate speech into text. Certain software applications can convert live voice and recorded speech into a text file. The speech can be segmented by intensities on time-frequency bands as well.
 

Real-world examples of speech recognition:

  • Voice search
  • Voice dialling
  • Appliance control

Some of the most common uses of speech recognition software are devices like Google Home or Amazon Alexa.

3. Medical diagnosis

Machine learning can help with the diagnosis of diseases. Many physicians use chatbots with speech recognition capabilities to discern patterns in symptoms.
 

Real-world examples for medical diagnosis:

  • Assisting in formulating a diagnosis or recommends a treatment option
  • Oncology and pathology use machine learning to recognise cancerous tissue 
  • Analyse bodily fluids

In the case of rare diseases, the joint use of facial recognition software and machine learning helps scan patient photos and identify phenotypes that correlate with rare genetic diseases.

4. Statistical arbitrage

Arbitrage is an automated trading strategy that’s used in finance to manage a large volume of securities. The strategy uses a trading algorithm to analyse a set of securities using economic variables and correlations.
 

Real-world examples of statistical arbitrage:

  • Algorithmic trading which analyses a market microstructure
  • Analyse large data sets
  • Identify real-time arbitrage opportunities

Machine learning optimises the arbitrage strategy to enhance results.

5. Predictive analytics

Machine learning can classify available data into groups, which are then defined by rules set by analysts. When the classification is complete, the analysts can calculate the probability of a fault.
 

Real-world examples of predictive analytics:

  • Predicting whether a transaction is fraudulent or legitimate
  • Improve prediction systems to calculate the possibility of fault

Predictive analytics is one of the most promising examples of machine learning. It’s applicable for everything; from product development to real estate pricing.

6. Extraction

Machine learning can extract structured information from unstructured data. Organisations amass huge volumes of data from customers. A machine learning algorithm automates the process of annotating datasets for predictive analytics tools.
 

Real-world examples of extraction:

  • Generate a model to predict vocal cord disorders
  • Develop methods to prevent, diagnose, and treat the disorders
  • Help physicians diagnose and treat problems quickly

Typically, these processes are tedious. But machine learning can track and extract information to obtain billions of data samples. 

Machine learning in the future

Machine learning is a remarkable technology in the field of artificial intelligence. Even in its earliest uses, machine learning has already improved our daily lives and the future..

If you’re ready to apply machine learning to your business strategy and create customised experiences, check out the Personalisation Builder. Use the power of predictive analytics and modelling to understand each customer’s preferences!

Personalization Builder

Use the power of predictive analytics and modeling to understand each customer’s preferences and automatically tailor content delivered in email and on the web.

Interested in artificial intelligence and how it’s affecting the global business landscape? Discover the benefits of AI for businesses in every industry.

Machine learning, explained

Machine learning is behind chatbots and predictive text, language translation apps, the shows Netflix suggests to you, and how your social media feeds are presented. It powers autonomous vehicles and machines that can diagnose medical conditions based on images. 

When companies today deploy artificial intelligence programs, they are most likely using machine learning — so much so that the terms are often used interchangeably, and sometimes ambiguously. Machine learning is a subfield of artificial intelligence that gives computers the ability to learn without explicitly being programmed.

“In just the last five or 10 years, machine learning has become a critical way, arguably the most important way, most parts of AI are done,” said MIT Sloan professorThomas W. Malone, the founding director of the MIT Center for Collective Intelligence. “So that’s why some people use the terms AI and machine learning almost as synonymous … most of the current advances in AI have involved machine learning.”

With the growing ubiquity of machine learning, everyone in business is likely to encounter it and will need some working knowledge about this field. A 2020 Deloitte survey found that 67% of companies are using machine learning, and 97% are using or planning to use it in the next year.

From manufacturing to retail and banking to bakeries, even legacy companies are using machine learning to unlock new value or boost efficiency. “Machine learning is changing, or will change, every industry, and leaders need to understand the basic principles, the potential, and the limitations,” said MIT computer science professor Aleksander Madry, director of the MIT Center for Deployable Machine Learning.

While not everyone needs to know the technical details, they should understand what the technology does and what it can and cannot do, Madry added. “I don’t think anyone can afford not to be aware of what’s happening.”

That includes being aware of the social, societal, and ethical implications of machine learning. “It’s important to engage and begin to understand these tools, and then think about how you’re going to use them well. We have to use these [tools] for the good of everybody,” said Dr. Joan LaRovere, MBA ’16, a pediatric cardiac intensive care physician and co-founder of the nonprofit The Virtue Foundation. “AI has so much potential to do good, and we need to really keep that in our lenses as we’re thinking about this. How do we use this to do good and better the world?”

What is machine learning?

Machine learning is a subfield of artificial intelligence, which is broadly defined as the capability of a machine to imitate intelligent human behavior. Artificial intelligence systems are used to perform complex tasks in a way that is similar to how humans solve problems.

The goal of AI is to create computer models that exhibit “intelligent behaviors” like humans, according to Boris Katz, a principal research scientist and head of the InfoLab Group at CSAIL. This means machines that can recognize a visual scene, understand a text written in natural language, or perform an action in the physical world.

Machine learning is one way to use AI. It was defined in the 1950s by AI pioneer Arthur Samuel as “the field of study that gives computers the ability to learn without explicitly being programmed.”

The definition holds true, according toMikey Shulman, a lecturer at MIT Sloan and head of machine learning at Kensho, which specializes in artificial intelligence for the finance and U.S. intelligence communities. He compared the traditional way of programming computers, or “software 1.0,” to baking, where a recipe calls for precise amounts of ingredients and tells the baker to mix for an exact amount of time. Traditional programming similarly requires creating detailed instructions for the computer to follow.

But in some cases, writing a program for the machine to follow is time-consuming or impossible, such as training a computer to recognize pictures of different people. While humans can do this task easily, it’s difficult to tell a computer how to do it. Machine learning takes the approach of letting computers learn to program themselves through experience. 

Machine learning starts with data — numbers, photos, or text, like bank transactions, pictures of people or even bakery items, repair records, time series data from sensors, or sales reports. The data is gathered and prepared to be used as training data, or the information the machine learning model will be trained on. The more data, the better the program.

From there, programmers choose a machine learning model to use, supply the data, and let the computer model train itself to find patterns or make predictions. Over time the human programmer can also tweak the model, including changing its parameters, to help push it toward more accurate results. (Research scientist Janelle Shane’s website AI Weirdness is an entertaining look at how machine learning algorithms learn and how they can get things wrong — as happened when an algorithm tried to generate recipes and created Chocolate Chicken Chicken Cake.)

Some data is held out from the training data to be used as evaluation data, which tests how accurate the machine learning model is when it is shown new data. The result is a model that can be used in the future with different sets of data.

Successful machine learning algorithms can do different things, Malone wrote in a recent research brief about AI and the future of work that was co-authored by MIT professor and CSAIL director Daniela Rus and Robert Laubacher, the associate director of the MIT Center for Collective Intelligence.

“The function of a machine learning system can be descriptive, meaning that the system uses the data to explain what happened; predictive, meaning the system uses the data to predict what will happen; or prescriptive, meaning the system will use the data to make suggestions about what action to take,” the researchers wrote.  

There are three subcategories of machine learning:

Supervised machine learning models are trained with labeled data sets, which allow the models to learn and grow more accurate over time. For example, an algorithm would be trained with pictures of dogs and other things, all labeled by humans, and the machine would learn ways to identify pictures of dogs on its own. Supervised machine learning is the most common type used today.

In unsupervised machine learning, a program looks for patterns in unlabeled data. Unsupervised machine learning can find patterns or trends that people aren’t explicitly looking for. For example, an unsupervised machine learning program could look through online sales data and identify different types of clients making purchases.

Reinforcement machine learning trains machines through trial and error to take the best action by establishing a reward system. Reinforcement learning can train models to play games or train autonomous vehicles to drive by telling the machine when it made the right decisions, which helps it learn over time what actions it should take.

Infographic entitled "What do you want your machine learning system to do?"

In the Work of the Future brief, Malone noted that machine learning is best suited for situations with lots of data — thousands or millions of examples, like recordings from previous conversations with customers, sensor logs from machines, or ATM transactions. For example, Google Translate was possible because it “trained” on the vast amount of information on the web, in different languages.

In some cases, machine learning can gain insight or automate decision-making in cases where humans would not be able to, Madry said. “It may not only be more efficient and less costly to have an algorithm do this, but sometimes humans just literally are not able to do it,” he said.

Google search is an example of something that humans can do, but never at the scale and speed at which the Google models are able to show potential answers every time a person types in a query, Malone said. “That’s not an example of computers putting people out of work. It’s an example of computers doing things that would not have been remotely economically feasible if they had to be done by humans.”

Machine learning is also associated with several other artificial intelligence subfields:

Natural language processing

Natural language processing is a field of machine learning in which machines learn to understand natural language as spoken and written by humans, instead of the data and numbers normally used to program computers. This allows machines to recognize language, understand it, and respond to it, as well as create new text and translate between languages. Natural language processing enables familiar technology like chatbots and digital assistants like Siri or Alexa.

Neural networks

Neural networks are a commonly used, specific class of machine learning algorithms. Artificial neural networks are modeled on the human brain, in which thousands or millions of processing nodes are interconnected and organized into layers.

In an artificial neural network, cells, or nodes, are connected, with each cell processing inputs and producing an output that is sent to other neurons. Labeled data moves through the nodes, or cells, with each cell performing a different function. In a neural network trained to identify whether a picture contains a cat or not, the different nodes would assess the information and arrive at an output that indicates whether a picture features a cat.

Deep learning

Deep learning networks are neural networks with many layers. The layered network can process extensive amounts of data and determine the “weight” of each link in the network — for example, in an image recognition system, some layers of the neural network might detect individual features of a face, like eyes, nose, or mouth, while another layer would be able to tell whether those features appear in a way that indicates a face.  

Like neural networks, deep learning is modeled on the way the human brain works and powers many machine learning uses, like autonomous vehicles, chatbots, and medical diagnostics.

“The more layers you have, the more potential you have for doing complex things well,” Malone said.

Deep learning requires a great deal of computing power, which raises concerns about its economic and environmental sustainability.

How businesses are using machine learning

Machine learning is the core of some companies’ business models, like in the case of Netflix’s suggestions algorithm or Google’s search engine. Other companies are engaging deeply with machine learning, though it’s not their main business proposition.

Others are still trying to determine how to use machine learning in a beneficial way. “In my opinion, one of the hardest problems in machine learning is figuring out what problems I can solve with machine learning,” Shulman said. “There’s still a gap in the understanding.”

In a 2018 paper, researchers from the MIT Initiative on the Digital Economy outlined a 21-question rubric to determine whether a task is suitable for machine learning. The researchers found that no occupation will be untouched by machine learning, but no occupation is likely to be completely taken over by it. The way to unleash machine learning success, the researchers found, was to reorganize jobs into discrete tasks, some which can be done by machine learning, and others that require a human.

Companies are already using machine learning in several ways, including:

Recommendation algorithms. The recommendation engines behind Netflix and YouTube suggestions, what information appears on your Facebook feed, and product recommendations are fueled by machine learning. “[The algorithms] are trying to learn our preferences,” Madry said. “They want to learn, like on Twitter, what tweets we want them to show us, on Facebook, what ads to display, what posts or liked content to share with us.”

Image analysis and object detection. Machine learning can analyze images for different information, like learning to identify people and tell them apart — though facial recognition algorithms are controversial. Business uses for this vary. Shulman noted that hedge funds famously use machine learning to analyze the number of cars in parking lots, which helps them learn how companies are performing and make good bets.

Fraud detection. Machines can analyze patterns, like how someone normally spends or where they normally shop, to identify potentially fraudulent credit card transactions, log-in attempts, or spam emails.

Automatic helplines or chatbots. Many companies are deploying online chatbots, in which customers or clients don’t speak to humans, but instead interact with a machine. These algorithms use machine learning and natural language processing, with the bots learning from records of past conversations to come up with appropriate responses.

Self-driving cars. Much of the technology behind self-driving cars is based on machine learning, deep learning in particular.

Medical imaging and diagnostics. Machine learning programs can be trained to examine medical images or other information and look for certain markers of illness, like a tool that can predict cancer risk based on a mammogram.

READ REPORT: ARTIFICIAL INTELLIGENCE AND THE FUTURE OF WORK

How machine learning works: promises and challenges
While machine learning is fueling technology that can help workers or open new possibilities for businesses, there are several things business leaders should know about machine learning and its limits.

Explainability

One area of concern is what some experts call explainability, or the ability to be clear about what the machine learning models are doing and how they make decisions. “Understanding why a model does what it does is actually a very difficult question, and you always have to ask yourself that,” Madry said. “You should never treat this as a black box, that just comes as an oracle … yes, you should use it, but then try to get a feeling of what are the rules of thumb that it came up with? And then validate them.”

This is especially important because systems can be fooled and undermined, or just fail on certain tasks, even those humans can perform easily. For example, adjusting the metadata in images can confuse computers — with a few adjustments, a machine identifies a picture of a dog as an ostrich.

Madry pointed out another example in which a machine learning algorithm examining X-rays seemed to outperform physicians. But it turned out the algorithm was correlating results with the machines that took the image, not necessarily the image itself. Tuberculosis is more common in developing countries, which tend to have older machines. The machine learning program learned that if the X-ray was taken on an older machine, the patient was more likely to have tuberculosis. It completed the task, but not in the way the programmers intended or would find useful.

The importance of explaining how a model is working — and its accuracy — can vary depending on how it’s being used, Shulman said. While most well-posed problems can be solved through machine learning, he said, people should assume right now that the models only perform to about 95% of human accuracy. It might be okay with the programmer and the viewer if an algorithm recommending movies is 95% accurate, but that level of accuracy wouldn’t be enough for a self-driving vehicle or a program designed to find serious flaws in machinery.

Bias and unintended outcomes

Machines are trained by humans, and human biases can be incorporated into algorithms — if biased information, or data that reflects existing inequities, is fed to a machine learning program, the program will learn to replicate it and perpetuate forms of discrimination. Chatbots trained on how people converse on Twitter can pick up on offensive and racist language, for example.

In some cases, machine learning models create or exacerbate social problems. For example, Facebook has used machine learning as a tool to show users ads and content that will interest and engage them — which has led to models showing people extreme content that leads to polarization and the spread of conspiracy theories when people are shown incendiary, partisan, or inaccurate content.

Ways to fight against bias in machine learning including carefully vetting training data and putting organizational support behind ethical artificial intelligence efforts, like making sure your organization embraces human-centered AI, the practice of seeking input from people of different backgrounds, experiences, and lifestyles when designing AI systems. Initiatives working on this issue include the Algorithmic Justice League and The Moral Machine project.

Putting machine learning to work
Shulman said executives tend to struggle with understanding where machine learning can actually add value to their company. What’s gimmicky for one company is core to another, and businesses should avoid trends and find business use cases that work for them.

Machine learning is changing, or will change, every industry, and leaders need to understand the basic principles, the potential, and the limitations.
Aleksander Madry
MIT Computer Science Professor


The way machine learning works for Amazon is probably not going to translate at a car company, Shulman said — while Amazon has found success with voice assistants and voice-operated speakers, that doesn’t mean car companies should prioritize adding speakers to cars. More likely, he said, the car company might find a way to use machine learning on the factory line that saves or makes a great deal of money.

“The field is moving so quickly, and that’s awesome, but it makes it hard for executives to make decisions about it and to decide how much resourcing to pour into it,” Shulman said.

It’s also best to avoid looking at machine learning as a solution in search of a problem, Shulman said. Some companies might end up trying to backport machine learning into a business use. Instead of starting with a focus on technology, businesses should start with a focus on a business problem or customer need that could be met with machine learning.

A basic understanding of machine learning is important, LaRovere said, but finding the right machine learning use ultimately rests on people with different expertise working together. “I’m not a data scientist. I’m not doing the actual data engineering work — all the data acquisition, processing, and wrangling to enable machine learning applications — but I understand it well enough to be able to work with those teams to get the answers we need and have the impact we need,” she said. “You really have to work in a team.”

Learn more:

Sign-up for a Machine Learning in Business Course.

Watch an Introduction to Machine Learning through MIT OpenCourseWare.

Read about how an AI pioneer thinks companies can use machine learning to transform.

Watch a discussion with two AI experts about machine learning strides and limitations.

Take a look at the seven steps of machine learning.