Tag Archives for " Machine :Learning "

Voices in AI – Episode 67: A Conversation with Amir Khosrowshahi

About this Episode

Episode 67 of Voices in AI features host Byron Reese and Amir Khosrowshahi talk about the explainability, privacy, and other implications of using AI for business.

Amir Khosrowshahi is VP and CTO at Intel. He holds a Bachelor’s Degree from Harvard in Physics and Math, a Master’s Degree from Harvard in Physics, and a Ph.D. in Computational Neuroscience from UC Berkeley.

Visit www.VoicesinAI.com to listen to this one-hour podcast or read the full transcript.

Transcript Excerpt

Byron Reese: This is Voices in AI brought to you by GigaOm.

I’m Byron Reese. Today I’m so excited that my guest is Amir Khosrowshahi. He is a VP and the CTO of AI products over at Intel.

He holds a Bachelor’s Degree from Harvard in Physics and Math, a Master’s Degree from Harvard in Physics, and a Ph.D. in Computational Neuroscience from UC Berkeley.

Welcome to the show, Amir.

Amir Khosrowshahi: Thank you, thanks for having me.

I can’t imagine someone better suited to talking about the kinds of things we talk about on this show, because you’ve got a Ph.D. in Computational Neuroscience, so, start off by just telling us what is Computational Neuroscience?

So neuroscience is a field, the study of the brain, and it is mostly a biologically minded field, and of course, there are aspects of the brain that are computational and there are aspects of the brain that are opening up the skull and peering inside and sticking needles into areas and doing all sorts of different kinds of experiments.

Human Brain & Neuron Model

Computational neuroscience is a combination of these two threads, the thread that there [are] computer science statistics and machine learning and mathematical aspects to intelligence, and then there’s biology, where you are making an attempt to map equations from machine learning to what is actually going on in the brain.

I have a theory that I may not be qualified to have and you certainly are, and I would love to know your thoughts on it.

I think it’s very interesting that people are really good at getting trained with a sample size of one, like draw a made-up alien you’ve never seen before and then I can show you a series of photographs, and even if that alien’s upside down, underwater, behind a tree, whatever, you can spot it.

Further, I think it’s very interesting that people are so good at transfer learning, I could give you two objects like a trout swimming in a river, and that same trout in a jar of formaldehyde in a laboratory and I could ask you a series of questions: Do they weigh the same, are they the same color, do they smell the same, are they the same temperature?

And you would instantly know, and yet, likewise, if you were to ask me if hitting your thumb with a hammer hurts, and I would say “yes,” and then somebody would say, “Well, have you ever done it?”

And I’m like, “yeah,” and they would say, “when?” And it’s like, I don’t really remember, I know I have.

Somehow we take data and throw it out, and remember metadata, and yet the fact a hammer hurts your thumb is stored in some little part of your brain that you could cut it out and somehow forget that.

And so when I think of all of those things that seem so different than computers to me, I kind of have a sense that human intelligence doesn’t really tell us anything about how to build artificial intelligence. What do you say?

Okay, those are very deep questions, and actually, each one of those items is a separate thread in the field of machine learning and artificial intelligence.

There are lots of people working on things, so the first thing you mentioned I think, was one shot learning where you have, you see as something that’s novel.

From the first time you see it, you recognize it as something that’s singular and you retain that knowledge to then identify if it occurs again—such as for a child it would be like a chair, for you, it’s potentially an alien.

So, how do you learn from single examples?

Artificial-Intelligence-Brain

That’s an open problem in machine learning and is very actively studied because you want to be able to have a parsimonious strategy for learning and the current ways that—it’s a good problem to have—the current ways that we’re doing learning in, for example, online services that sort photos and recognize objects and images.

It’s very computationally wasteful and it’s actually wasteful in the usage of data.

You have to see many examples of chairs to have an understanding of a chair, and it’s actually not clear if you actually have an understanding of a chair, because the models that we have today for chairs, do make mistakes.

When you peer into where the mistakes were made, it seems like there the machine learning model doesn’t actually have an understanding of a chair, it doesn’t have a semantic understanding of a scene or of grammar, or of languages that are translated, and we’re noticing these efficiencies and we’re trying to address them.

AI Tech

You mentioned some other things, such as how do you transfer knowledge from one domain to the next.

Humans are very good at generalizing.

We see an example of something in one context, and it’s amazing that you can extrapolate or transfer it to a completely different context.

That’s also something that we’re working on quite actively, and we have some initial success in that we can take a statistical model that was trained on one set of data, and then we can then apply it to another set of data by using that previous experience as a warm start, and then moving away from that old domain to the new domain.

This is also possible to do in continuous time.

Much of the things we experience in the real world—they’re not stationary, and that’s a statistics change with time.

We need to have models that can also change.

For a human it’s easy to do that, it’s very good at going from… it’s good at handling non-stationary statistics, so we need to build that into our models, be cognizant of it, we’re working on it. And then [for] other things you mentioned—that intuition is very difficult.

It’s potentially one of the most difficult things for us to translate from human intelligence to machines, and remembering things and having kind of a hazy idea of having done something bad to yourself with a hammer, that I’m not actually sure where that falls in into the various subdomains of machine learning.

Listen to this one-hour episode or read the full transcript at www.VoicesinAI.com

 

Byron explores issues around artificial intelligence and conscious computers in his new book The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity.

Source: gigaom.com

Machine Learning

Speed and Scale: Advanced Analytics with Machine Learning

Artificial Intelligence and Machine Learning (ML) can turn massive amounts of data into deep insights that drive revenue and decrease costs. But ML’s not an island – in fact, it’s carried out most successfully when paired with advanced analytics.

Artificial Intelligence-Machine Learning-Deep Learning Technologies

To facilitate the best analytics work, enterprises need the right platforms and tools to load data, prepare it, ensure high quality and integrate with corporate data governance processes.

How can you get all that working harmoniously, especially in the cloud?

It takes the right tools, strategy, and workflow, but it can be done.

Apple Podcast Girl

Join us for this free 1-hour webinar, from GigaOm Research, to find out how.

The webinar features GigaOm analyst Andrew Brust, Deepsha Menghani, Product Marketing Manager at Microsoft, and Mark Balkenende, Director Technical Product Marketing at Talend.

In this 1-hour webinar, you will learn how:

  • Data analytics, data quality, and data governance can be tightly intertwined with data science
  • Technologies like Apache Spark can serve both your data engineering and machine learning needs
  • Cloud services can be combined with open-source software and analytics ecosystem tools for maximum benefit

Machine Learning and AI
Register now to join GigaOm Research, Microsoft, and Talend for this free expert webinar.

Who Should Attend:

  • CIOs
  • CTOs
  • Chief Data Officers
  • Data Scientists
  • Data Engineers
  • Data Stewards
  • Analytics professionals

 

Source: gigaom.com

Voices in AI – Episode 72: A Conversation with Irving Wladawsky-Berger

About this Episode

Episode 72 of Voices in AI features host Byron Reese and Irving Wladawsky-Berger discuss the complexity of the human brain, the possibility of AGI and its origins, the implications of AI in weapons, and where else AI has and could take us.

Irving has a Ph.D. in Physics from the University of Chicago, is a research affiliate with the MIT Sloan School of Management, he is a guest columnist for the Wall Street Journal and CIO Journal, he is an agent professor of the Imperial College of London, and he is a fellow for the Center for Global Enterprise.

Visit www.VoicesinAI.com to listen to this one-hour podcast or read the full transcript.

Transcript Excerpt

Byron Reese: This is Voices in AI, brought to you by GigaOm, and I’m Byron Reese.

Today our guest is Irving Wladawsky-Berger.

He is a bunch of things. He is a research affiliate with the MIT Sloan School of Management.

He is a guest columnist for the Wall Street Journal and CIO Journal.

He is an adjunct professor at the Imperial College of London.

He is a fellow for the Center for Global Enterprise, and I think a whole lot more things. Welcome to the show, Irving.

Irving Wladawsky-Berger: Byron it’s a pleasure to be here with you.

Artificial Intelligence Good or Bad

So, that’s a lot of things you do. What do you spend most of your time doing?

Well, I spend most of my time these days either in MIT-oriented activities or writing my weekly columns, [which] take quite a bit of time.

So, those two are a combination, and then, of course, doing activities like this – talking to you about AI and related topics.

Business Technologies & Strategies

So, you have an M.S. and a Ph.D. in Physics from the University of Chicago.

Tell me… how does artificial intelligence play into the stuff you do on a regular basis?

Well, first of all, I got my Ph.D. in Physics in Chicago in 1970.

I then joined IBM research in Computer Science.

I switched fields from Physics to Computer Science because as I was getting my degree in the ‘60s, I spent most of my time computing.

 

And then you spent 37 years at IBM, right?

Yeah, then I spent 37 years at IBM working full time, and another three and a half years as a consultant.

So, I joined IBM research in 1970, and then about four years later my first management job was to organize an AI group.

Now, Byron, AI in 1974 was very very very different from AI in 2018.

I’m sure you’re familiar with the whole history of AI.

If not, I can just briefly tell you about evolution.

I’ve seen it, having been involved with it in one way or another for all these years.

AI-Artificial Intelligence Benefits & Risks

So, back then did you ever have occasion to meet [John] McCarthy or any of the people at the Dartmouth [Summer Research Project]?

Yeah, yeah.

 

So, tell me about that. Tell me about the early early days in AI, before we jump into today.

I knew people at the MIT AI lab… Marvin Minsky, McCarthy, and there were a number of other people.

You know, what’s interesting is at the time the approach to AI was to try to program intelligence, writing it in Lisp, which John McCarthy invented as a special programming language; writing in rules-based languages; writing in Prolog.

At the time – remember this was years ago – they all thought that you could get AI done that way and it was just a matter of time before computers got fast enough for this to work.

Clearly, that approach toward artificial intelligence didn’t work at all.

You couldn’t program something like intelligence when we didn’t understand at all how it worked…

AI Operations

Well, to pause right there for just a second…

The reason they believed that – and it was a reasonable assumption – the reason they believed it is because they looked at things like Isaac Newton coming up with three laws that covered planetary motion, and Maxwell and different physical systems that only were governed by two or three simple laws and they hoped intelligence was.

Do you think there’s any aspect of intelligence that’s really simple and we just haven’t stumbled across it, that you just iterate something over and over again?

Any aspect of intelligence that’s like that?

I don’t think so, and in fact, my analogy… and I’m glad you brought up Isaac Newton.

This goes back to physics, which is what I got my degrees in.

This is like comparing classical mechanics, which is deterministic.

You know, you can tell precisely, based on classical mechanics, the motion of planets.

If you throw a baseball, where is it going to go, etc?

And as we know, classical mechanics does not work at the atomic and subatomic levels.

We have something called quantum mechanics, and in quantum mechanics, nothing is deterministic.

You can only tell what things are going to do based on something called a wave function, which gives you a probability.

I really believe that AI is like that, that it is so complicated, so emergent, so chaotic; etc., that the way to deal with AI is in a more probabilistic way.

That has worked extremely well, and the previous approach where we try to write things down in a sort of deterministic way like classical mechanics, that just didn’t work.

Byron, imagine if I asked you to write down specifically how you learned to ride a bicycle.

I bet you won’t be able to do it.

I mean, you can write a poem about it.

But if I say, “No, no, I want a computer program that tells me precisely…”

If I say, “Byron I know you know how to recognize a cat.

Tell me how you do it.”

I don’t think you’ll be able to tell me, and that’s why that approach didn’t work.

Artificial Intelligence-Machine Learning-Deep Learning Technologies

And then, lo and behold, in the ‘90s we discovered that there was a whole different approach to AI-based on getting lots and lots of data in very fast computers, analyzing the data, and then something like intelligence starts coming out of all that.

I don’t know if it’s intelligence, but it doesn’t matter.

I really think that to a lot of people the real point where that hit home is when in the late ‘90s, IBM’s Deep Blue supercomputer, beat Garry Kasparov in a very famous [chess]match.

I don’t know, Byron, if you remember that.

Listen to this one-hour episode or read the full transcript at www.VoicesinAI.com

 

Byron explores issues around artificial intelligence and conscious computers in his new book The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity.

Source: gigaom.com

AI (ML/DL) Operations

AI Operations: It Can’t Be Just an Afterthought

In the worlds of machine learning (ML) and deep learning (DL), operations and deployment is a subject that often falls by the wayside.

And the split reality between everyday on-premises Artificial Intelligence (AI) work and the industry’s fascination with more aspirational cloud-based AI work only makes matters worse.

Reasons to use AI

Reasons to use AI

For the adoption of AI/ML/DL to be actionable for Enterprise customers, the full spectrum of on-premises and cloud-based work needs to be accommodated.

Deployment and operations across environments need to be consistent.

On-premises provisioning and deployment should feel cloud-like in ease-of-use, and hybrid scenarios need to be handled robustly.

Installation and management of frameworks and models need to be handled too.

Join us for this free 1-hour webinar, from GigaOm Research, to explore these matters.

Live Podcast

The Webinar features GigaOm analyst Andrew Brust and special guests, Adnan Khaleel from Dell EMC, and Professor Sambit Bhattacharya of Fayetteville State University, a customer of Bright Computing.

This webinar is sponsored by Dell EMC, NVIDIA, and Bright Computing.

In this 1-hour webinar, attendees discover:

  • How cross-premises AI deployment is both necessary and achievable
  • What “AI Ops” looks like today, and where it’s going
  • The sweet spot of ML/DL training workloads between the data center and cloud

Register now to join GigaOm Research and Dell EMC for this free expert webinar.

Who Should Attend:

  • CIOs
  • CTOs
  • Chief Data Officers
  • Data Scientists
  • IT/Data Center specialists
  • DevOps professionals

Source: gigaom.com

Voices in AI – Episode 70: A Conversation with Jakob Uszkoreit

About this Episode

Episode 70 of Voices in AI features host Byron Reese and Jakob Uszkoreit discuss machine learning, deep learning, AGI, and what this could mean for the future of humanity.

Jakob has a master’s degree in Computer Science and Mathematics from Technische Universität Berlin.

Jakob has also worked at Google for the past 10 years currently in deep learning research with Google Brain.

Visit www.VoicesinAI.com to listen to this one-hour podcast or read the full transcript.

Transcript Excerpt

Byron Reese: This is Voices in AI, brought to you by GigaOm. I’m Byron Reese. Today our guest is Jakob Uszkoreit, he is a researcher at Google Brain, and that’s kind of all you have to say at this point. Welcome to the show, Jakob.

Q:1

Let’s start with my standard question which is: What is artificial intelligence, and what is intelligence if you want to start there, and why is it artificial?

 

Jakob Uszkoreit: Hi, thanks for having me.

Let’s start with artificial intelligence specifically.

I don’t think I’m necessarily the best person to answer the question of what intelligence is in general, but I think for artificial intelligence, there are possibly two different kinds of ideas that we might be referring to with that phrase.

One is kind of the scientific or the group of directions of scientific research, including things like machine learning, but also other related disciplines that people commonly refer to with the term ‘artificial intelligence.’

AI-ML-Robotics Technologies

But I think there’s this other may be a more important use of the phrase that has become much more common in this age of the rise of AI if you want to call it that, and that is what society interprets that term to mean.

I think largely what society might think when they hear the term artificial intelligence, is actually automation, in a very general way, and maybe more specifically, automation where the process of automating [something] requires the machine or the machines doing so to make decisions that are highly dynamic in response to their environment and in our ideas or in our conceptualization of those processes, require something like human intelligence.

So, I really think it’s actually something that doesn’t necessarily, in the eyes of the public, have that much to do with intelligence, per se.

It’s more the idea of automating things that at least so far, only humans could do, and the hypothesized reason for that is that only humans possess this ephemeral thing of intelligence.

AI (ML/DL) Operations

Q:2

Do you think it’s a problem that a cat food dish that refills itself when it’s empty, you could say has a rudimentary AI, and you can say Westworld is populated with AIs, and those things are so vastly different, and they’re not even really on a continuum, are they?

General intelligence isn’t just a better narrow intelligence, or is it?

 

So I think that’s a very interesting question.

Whether basically improving and slowly generalizing or expanding the capabilities of narrow bits of intelligence, will eventually get us there, and if I had to venture a guess, I would say that’s quite likely actually.

That said, I’m definitely not the right person to answer that.

I do think that guesses, that aspects of things are today still in the realms of philosophy and extremely hypothetical.

Artificial Intelligence Good or Bad

Q:3

But the one trick that we have gotten good at recently that’s given us things like AlphaZero, is machine learning, right?

And it is itself a very narrow thing.

It basically has one core assumption, which is the future is like the past.

And for many things, it is: what a dog looks like in the future, is what a dog looked like yesterday.

But, one has to ask the question, “How much of life is actually like that?”

Do you have an opinion on that?

 

Yeah, so I think that machine learning is actually evolving rapidly from the initial classic idea of basically trying to predict the future just in the past, and not just the past as a kind of encapsulated version of the past.

So, it’s basically a snapshot captured in this fixed static data set.

You expose machines to that, you allow it to learn from that, train on that, whatever you want to call it, and then you evaluate how the resulting model or machine or network does in the wild or on some evaluation tasks, and tests that you’ve prepared for it.

Artificial-Intelligence-Brain

It’s evolving from that classic definition towards something that is quite a bit more dynamic, that is starting to incorporate learning in situ, learning kind of “on the job,” learning from very different kinds of supervision, where some of it might be encapsulated by data sets, but some might be given to the machine through somewhat more high-level interactions, maybe even through language.

There are at least a bunch of lines of research attempting that.

Also quite importantly, we’re starting slowly but surely to employ machine learning in ways where the machine’s actions actually have an impact on the world, from which the machine then keeps learning.

I think that that’s actually something [for which] all of these parts are necessary ingredients if we ever want to have narrow bits of intelligence, that maybe have a chance of getting more general.

Maybe then in the more distant future, might even be bolted together into somewhat more general artificial intelligence.

Listen to this one-hour episode or read the full transcript at www.VoicesinAI.com

Byron explores issues around artificial intelligence and conscious computers in his new book The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity.

Source: gigaom.com

Voices in AI – Episode 63: A Conversation with Hillery Hunter

About this Episode

Episode 63 of Voices in AI features host Byron Reese and Hillery Hunter discuss AI, deep learning, power efficiency, and understanding the complexity of what AI does with the data it is fed.

Hillery Hunter is an IBM Fellow and holds an MS and a Ph.D. in electrical engineering from the University of Illinois Urbana-Champaign.

Visit www.VoicesinAI.com to listen to this one-hour podcast or read the full transcript.

Transcript Excerpt

Byron Reese: This is Voices in AI brought to you by GigaOm, I’m Byron Reese. Today, our guest is Hillery Hunter. She is an IBM Fellow, and she holds an MS and a Ph.D. in electrical engineering from the University of Illinois Urbana-Champaign. Welcome to the show, Hillery.

Thank you it’s such a pleasure to be here today, looking forward to this discussion, Byron.

Q: 1

So, I always like to start off with my Rorschach test question, which is: what is artificial intelligence, and why is it artificial?

You know that’s a great question. My background is in hardware and in systems and in the actual compute substrate for AI.

So one of the things I like to do is sort of demystifying what AI is.

There are certainly a lot of definitions out there, but I like to take people to the math that’s actually happening in the background.

So when we talk about AI today, especially in the popular press and such and people talk about the things that AI is doing, be it understanding medical stands or labeling people’s pictures on a social media platform, or understanding speech or translating language, all those things that are considered core functions of AI today are actually deep learning, which means using many-layered neural networks to solve a problem.

There are also other parts of AI though, that is much less discussed in the popular press, which includes knowledge and reasoning and creativity and all these other aspects.

And you know the reality is where we are today with AI, is we’re seeing a lot of productivity from the deep learning space and ultimately those are big math equations that are solved with lots of matrix math, and we’re basically creating a big equation that matches in its parameters to a set of data that it was fed.

Artificial Intelligence-Machine Learning-Deep Learning Technologies

Q: 2

So, would you say though that it is actually intelligent, or that it is emulating intelligence, or would you say there’s no difference between those two things?

Yeah, so I’m really quite pragmatic as you just heard from me saying,

“Okay, let’s go talk about what the math is that’s happening,” and right now where we’re at with AI is relatively narrow capabilities.

AI is good at doing things like classification or answering yes and no kind of questions on data that it was fed and so in some sense, it’s mimicking intelligence in that it is taking in sort of human sensory data a computer can take in.

What I mean by that is it can take in visual data or auditory data, people are even working on sensory data and things like that.

But basically, a computer can now take in things that we would consider sort of human process data, so visual things and auditory things, and make determinations as to what it thinks it is, but certainly far from something that’s actually thinking and reasoning and showing intelligence.

Reasons to use AI

Q: 3

Well, staying squarely in the practical realm, that approach, which is basically, let’s look at the past and make guesses about the future, what is the limit of what that can do?

I mean, for instance, is that approach going to master natural language for instance?

Can you just feed a machine enough printed material and have it be able to converse?

Like what are some things that the model may not actually be able to do?

Yeah, you know it’s interesting because there’s a lot of debate.

What are we doing today that’s different from analytics?

We had the big data era, and we talked about doing analytics on the data.

What’s new and what’s different and why are we calling it AI now?

To refer to your question from that direction, one of the things that AI models do, be it anything from a deep learning model to something that’s more in the knowledge reasoning area, is that they’re much better interpolators, they’re much better able to predict on things that they’ve never seen before.

Classical rigid models that people programmed in computers, could answer “Oh, I’ve seen that thing before.”

With deep learning and with more modern AI techniques, we are pushing forward into computers and models being able to guess on things that they haven’t exactly seen before.

And so in that sense, there’s a good amount of interpolation influx, whether or not and how AI pushes into forecasting on things well outside the bounds of what it’s never seen before and moving AI models to be effective at types of data that are very different from what they’ve seen before, is the type of advancement that people are really pushing for at this point.

Listen to this one-hour episode or read the full transcript at www.VoicesinAI.com

 

Byron explores issues around artificial intelligence and conscious computers in his new book The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity.

Source: gigaom.com

Voices in AI – Episode 62: A Conversation with Atif Kureishy

About this Episode

Episode 62 of Voices in AI features host Byron Reese and Atif Kureishy discussing AI, deep learning, and the practical examples and implications in the business market and beyond.

Atif Kureishy is the Global VP of Emerging Practices at Think Big, a Teradata company.

He also has a B.S. in physics and math from the University of Maryland as well as an MS in distributive computing from Johns Hopkins University.

Visit www.VoicesinAI.com to listen to this one-hour podcast or read the full transcript.

Transcript Excerpt

Byron Reese: This is Voices in AI, brought to you by GigaOm, I’m Byron Reese. Today my guest is Atif Kureishy.

He is the Global VP of Emerging Practices, which is AI and deep learning at Think Big, a Teradata company.

He holds a BS in Physics and Math from the University of Maryland, Baltimore County, and an MS in distributive computing from Johns Hopkins University.

Welcome to the show Atif.

Atif Kureishy: Welcome, thank you, appreciate it.

Q: 1

So I always like to start off by just asking you to define artificial intelligence.

Yeah, definitely an important definition, one that unfortunately is overused and stretched in many different ways.

Here at Think Big we actually have a very specific definition within the enterprise.

But before I give that, for me in particular, when I think of intelligence, that conjures up the ability to understand, the ability to reason, the ability to learn, and we usually equate that to biological systems or living entities

And now with the rise of probably more appropriate machine intelligence, we’re applying the term ‘artificial’ to it, and the rationale is probably because machines aren’t living and they’re not biological systems.

So with that, the way we’ve defined AI, in particular, is: leveraging machine and deep learning to drive towards a specific business outcome.

And it’s about giving leverage for human workers, to enable higher degrees of assistance and higher degrees of automation.

And when we define AI in that way, we actually give it three characteristics.

Those three characteristics are the ability to sense and learn, and so that’s being able to understand massive amounts of data and demonstrate continuous learning, and detecting patterns and signals within the noise if you will.

And the second is being able to reason and infer, and that is driving intuition and inference with increasing accuracy again to maximize a business outcome or a business decision.

And then ultimately it’s about deciding and acting, so actioning or automating a decision based on everything that’s understood, to drive towards more informed activities that are based on corporate intelligence.

So that’s kind of how we view AI in particular.

AI-ML-Robotics Technologies

Q: 2

Well, I applaud you for having given it so much thought, and there’s a lot there to unpack.

You talked about intelligence being about understanding and reasoning and learning, and that was even in your three areas.

Do you believe machines can reason?

You know, over time, we’re going to start to apply algorithms and specific models to the concept of reasoning.

And so the ability to understand, the ability to learn, are things that we’re going to express in mathematical terms no doubt.

Does it give it human lifelike characteristics? That’s still something to be determined.

Human Brain & Neuron Model

Q: 3

Well, I don’t mean to be difficult with the definition because, as you point out, most people aren’t particularly rigorous when it comes to it.

But if it’s to drive an outcome, take a cat food dish that refills itself when it’s low, it can sense, it can reason that it should put more food in.

And then it can act and release a mechanism that refills the food dish, is that AI, in your understanding, and if not why isn’t that AI?

Yeah, I mean I think in some sense it checks a lot of the boxes, but the reality is, being able to adapt and understand what’s occurring.

For instance, if that cat is coming out during certain times of the day ensuring that meals are prepared in the right way and that they don’t sit out and become stale or become spoiled in any way.

And that is signs of a more intelligent type of capability that is learning the behaviors and anticipating how best to respond given a specific outcome it’s driving towards.

AI System in Robot

Q: 4

Got you. So now, to take that definition, your company is Think Big.

What do you think big about? What is Think Big and what do you do?

So looking back in history a little bit, Think Big was actually an acquisition that Teradata had done several years ago, in the big data space, and particularly around open source and consulting.

And over time, Teradata had made several acquisitions and now we’ve unified all of those various acquisitions into a unified group, called Think Big Analytics.

And so what we’re particularly focused on is how do we drive business outcomes using advanced analytics and data science.

And we do that through a blend of approaches and techniques and technology frankly.

AI-Artificial Intelligence Benefits & Risks

Listen to this one-hour episode or read the full transcript at www.VoicesinAI.com

 

Byron explores issues around artificial intelligence and conscious computers in his new book The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity.

Source: gigaom.com

Voices in AI – Episode 61: A Conversation with Dr. Louis Rosenberg

About this Episode

Episode 61 of Voices in AI features host Byron Reese and Dr. Louis Rosenberg talking about AI and swarm intelligence. Dr. Rosenberg is the CEO of Unanimous AI. He also holds a B.S., M.S., and a Ph.D. in Engineering from Stanford.

Visit www.VoicesinAI.com to listen to this one-hour podcast or read the full transcript.

Transcript Excerpt

Byron Reese: This is Voices in AI, brought to you by GigaOm. I’m Byron Reese and today I’m excited that our guest is Louis Rosenberg.

He is the CEO at Unanimous A.I. He holds a B.S. in Engineering, an M.S. in Engineering, and a Ph.D. in Engineering all from Stanford. Welcome to the show, Louis.

Dr. Louis Rosenberg: Yeah, thanks for having me.

 

Q: 1

So tell me a little bit about why do you have a company? Why are you CEO of a company called Unanimous A.I.?

What is the unanimous aspect of it?

Sure. So, what we do at Unanimous A.I. is we use artificial intelligence to amplify the intelligence of groups rather than using A.I. to replace people.

And so instead of replacing human intelligence, we are amplifying human intelligence by connecting people together using A.I. algorithms.

So in laymen’s terms, you would say we build hive minds. In scientific terms, we would say we build artificial swarm intelligence by connecting people together into systems.

Honey Bee Hive-Natural

Q: 2

What is swarm intelligence?

So swarm intelligence is a biological phenomenon that people have been studying, or biologists have been studying, since the 1950s.

And it is basically the reason why birds flock and fish school and bees swarm—they are smarter together than they would be on their own.

And the way they become smarter together is not the way people do it. They don’t take calls, they don’t conduct surveys, there’s no SurveyMonkey in nature.

The way that groups of organisms get smarter together is by forming systems, real-time systems with feedback loops so that they can essentially think together as an emergent intelligence that is smarter as a uniform system than the individual participants would be on their own.

And so the way I like to think of an artificial swarm intelligence or a hive mind is as a brain of brains.

And that’s essentially what we focus on at Unanimous A.I., is figuring out how to do that among people, even though nature has figured out how to do that among birds and bees and fish, and have demonstrated over millions of years and hundreds of millions of years, how powerful it can be.

Bee Swarm

Q: 3

So before we talk about artificial swarm intelligence, let’s just spend a little time really trying to understand what it is that the animals are doing.

So the thesis is, your average ant isn’t very smart and even the smartest and isn’t very smart and yet collectively they exhibit behavior that’s quite intelligent.

They can do all kinds of things and forage and do this and that, and build a home and protect themselves from a flood and all of that. So how does that happen?

Yeah, so it’s an amazing process, and it’s worth taking one little step back and just asking ourselves, how do we define the term intelligence?

And then we can talk about how we can build a swarm intelligence.

And so, in my mind, the word intelligence could be defined as a system that takes in noisy input about the world and it processes that input and it uses it to make decisions, to have opinions, to solve problems and, ideally, it does it creatively and by learning over time.

And so if that’s intelligence, then there are lots of ways we can think about building artificial intelligence, which I would say is basically creating a system that involves technology that does some or all of these systems, takes in noisy input, and uses it to make decisions, have opinions, solve problems, and does it creatively and learning over time.

 Swimming fish school

Now, in nature, there’s really been two paths by which nature has figured out how to do these things, how to create intelligence.

One path is the path we’re very, very familiar with, which is by building up systems of neurons.

And so, over hundreds of millions and billions of years, nature figured out that if you build these systems of neurons, which we call brains, you can take in information about the world and you can use it to make decisions and have opinions and solve problems and do it creatively and learn over time.

But what nature has also shown is that in many organisms—particularly social organisms—once they’ve built that brain and they have an individual organism that can do this on their own, many social organisms then evolve the ability to connect the brains together into systems.

So if a brain is a network of neurons where intelligence emerges, a swarm in nature is a network of brains that are connected deeply enough that a superintelligence emerges.

And by superintelligence, we mean that the brain of brains is smarter together than those individual brains would be on their own.

And as you described, it happens in ants, it happens in bees, it happens in birds, and fish.

Migrating Flight of a Flock of Birds

And let me talk about bees because that happens to be the type of swarm intelligence that’s been studied the longest in nature.

And so, if you think about the evolution of bees, they first developed their individual brains, which allowed them to process information, but at some point, their brains could not get any larger, presumably because they fly, and so bees fly around, their brains are very tiny to be able to allow them to do that.

In fact, a honeybee has a brain that has less than a million neurons in it, and it’s smaller than a grain of sand.

And I know a million neurons sounds like a lot, but a human has 85 billion neurons. So however smart you are, divide that by 85,000 and that’s a honeybee.

So a single honeybee, very, very simple organism, and yet they have very difficult problems that they need to solve, just like humans have difficult problems.

Birds Flying in a Group

And so the type of problem that is actually studied the most in honeybees is picking a new home to move into.

And by a new home, I mean, you have a colony of 10,000 bees and every year they need to find a new home because they’ve outgrown their previous home and that home could be a hole in a hollow log, it could be a hole at the side of a building, it could be a hole—if you’re unlucky—in your garage, which happened to me.

And so a swarm of bees is going to need to find a new home to move into. And, again, it sounds like a pretty simple decision, but actually, it’s a life-or-death decision for honeybees.

And so for the evolution of bees, the better decision that they can make when picking a new home, the better the survival of their species.

And so, to solve this problem, what colonies of honeybees do is they form a hive mind or a swarm intelligence and the first step is that they need to collect information about their world.

And so they send out hundreds of scout bees out into the world to search 30 square miles to find potential sites, candidate sites that they can move into.

So that’s data collection. And so they’re out there sending hundreds of bees out into the world searching for different potential homes, then they bring that information back to the colony and now they have the difficult part of it: they need to make a decision, they need to pick the best possible site of dozens of possible sites that they have discovered.

Now, again, this sounds simple but honeybees are very discriminating house-hunters. They need to find a new home that satisfies a whole bunch of competing constraints.

That new home has to be large enough to store the honey they need for the winter. It needs to be ventilated well enough so they can keep it cool in the summer.

It needs to be insulated well enough so it can stay warm on cold nights. It needs to be protected from the rain, but also near good sources of water.

And also, of course, it needs to be well-located, near good sources of pollen.

Honey Bee opt for pollens

And so it’s a complex multi-variable problem. This is a problem that a single honeybee with a brain smaller than a grain of sand could not possibly solve.

In fact, a human that was looking at that data would find it very difficult to use a human brain to find the best possible solution to this multi-variable optimization problem.

Or a human that is faced with a similar human challenge, like finding the perfect location for a new factory or the perfect features of a new product or the perfect location to put a new store, would be very difficult to find a perfect solution.

And yet, rigorous studies by biologists have shown that honeybees pick the best solution from all the available options about 80% of the time.

And when they don’t pick the best possible solution, they pick the next best possible solution. And so it’s remarkable.

By working together as swarm intelligence, they are enabling themselves to make a decision that is optimized in a way that a human brain, which is 85,000 times more powerful, would struggle to do.

Human Brain & Neuron Model

And so how do they do this? Well, they form a real-time system where they can process the data together and converge together on the optimal solution.

Now, they’re honeybees, so how do they process the data? Well, nature came up with an amazing way. They do it by vibrating their bodies.

And so biologists call this a “waggle dance” because to humans when people first starting looking into hives, they saw these bees doing something that looked like they were dancing because they were vibrating their bodies.

It looked like they were dancing but really they were generating these vibrations, these signals that represent their support for their various home sites that were under consideration.

By having hundreds and hundreds of bees vibrating their bodies at the same time, they’re basically engaging in this multi-directional tug of war.

They’re pushing and pulling on a decision, exploring all the different options until they converge together in real-time on the one solution that they can best agree upon and it’s almost always the optimal solution.

And when it’s not the optimal solution, it’s the next best solution. So basically they’re forming this real-time system, this brain of brains that can converge together on an optimal solution and can solve problems that they couldn’t do on their own.

And so that’s the most well-known example of what a swarm intelligence is and we see it in honeybees, but we also see the same process happening in flocks of birds, in schools of fish, which allow them to be smarter together than alone.

Artificial-Intelligence-Brain

Listen to this one-hour episode or read the full transcript at www.VoicesinAI.com

 

Byron explores issues around artificial intelligence and conscious computers in his new book The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity.

Source: gigaom.com

Artificial-Intelligence-Brain

5 Common Misconceptions about AI

In recent years I ran into a number of misconceptions regarding AI, and sometimes when discussing AI with people from outside the field, I feel like we are talking about two different topics. This article is an attempt at clarifying what AI practitioners mean by AI, and where it is in its current state.

Artificial Intelligence

The first misconception has to do with Artificial General Intelligence or AGI:

 

1. Applied AI systems are just limited versions of AGI

Despite what many think, the state of the art in AI is still far behind human intelligence. Artificial General Intelligence, i.e. AGI, has been the motivating fuel for all AI scientists from Turing to today.

Somewhat analogous to Alchemy, the eternal quest for AGI that replicates and exceeds human intelligence has resulted in the creation of many techniques and scientific breakthroughs.

AGI has helped us understand facets of human and natural intelligence, and as a result, we’ve built effective algorithms inspired by our understanding and models of them.

However, when it comes to practical applications of AI, AI practitioners do not necessarily restrict themselves to pure models of human decision-making, learning, and problem-solving.

Rather, in the interest of solving the problem and achieving acceptable performance, AI practitioners often do what it takes to build practical systems.

At the heart of the algorithmic breakthroughs that resulted in Deep Learning systems, for instance, is a technique called back-propagation.

This technique, however, is not how the brain builds models of the world. This brings us to the next misconception:

 

2. There is a one-size-fits-all AI solution.

A common misconception is that AI can be used to solve every problem out there–i.e. the state-of-the-art AI has reached a level such that minor configurations of ‘the AI’ allows us to tackle different problems.

I’ve even heard people assume that moving from one problem to the next makes the AI system smarter as if the same AI system is now solving both problems at the same time.

The reality is much different: AI systems need to be engineered, sometimes heavily,  and require specifically trained models in order to be applied to a problem.

AI (ML/DL) Operations

And while similar tasks, especially those involving sensing the world (e.g., speech recognition, image or video processing) now have a library of available reference models, these models need to be specifically engineered to meet deployment requirements and may not be useful out of the box.

Furthermore, AI systems are seldom the only component of AI-based solutions. It often takes many tailor-made classically programmed components to come together to augment one or more AI techniques used within a system.

And yes, there are a multitude of different AI techniques out there, used alone or in hybrid solutions in conjunction with others, therefore it is incorrect to say:

 

3. AI is the same as Deep Learning

Back in the day, we thought the term artificial neural networks (ANNs) was really cool. Until that is, the initial euphoria around its potential backfired due to its lack of scaling and aptitude towards over-fitting.

Neural Network

Now that those problems have, for the most part, been resolved, we’ve avoided the stigma of the old name by “rebranding” artificial neural networks as  “Deep Learning”.

Deep Learning or Deep Networks are ANNs at scale, and the ‘deep’ refers not ‘too deep’ thinking, but to the number of hidden layers, we can now afford within our ANNs (previously it was a handful at most, and now they can be in the hundreds).

Deep Learning is used to generate models off of labeled data sets. The ‘learning’ in Deep Learning methods refers to the generation of the models, not to the models being able to learn in real-time as new data becomes available.

The ‘learning’ phase of Deep Learning models actually happens offline, needs many iterations, is time and process-intensive, and is difficult to parallelize.

Recently, Deep Learning models are being used in online learning applications. Online learning in such systems is achieved using different AI techniques such as Reinforcement Learning, or online Neuro-evolution.

A limitation of such systems is the fact that the contribution from the Deep Learning model can only be achieved if the domain of use can be mostly experienced during the offline learning period.

Once the model is generated, it remains static and not entirely robust to changes in the application domain.

A good example of this is in ecommerce applications–seasonal changes or short sales periods on ecommerce websites would require a deep learning model to be taken offline and retrained on sale items or new stock.

Data Virtualization

However, now with platforms like Sentient Ascend that use evolutionary algorithms to power website optimization, large amounts of historical data are no longer needed to be effective, rather, it uses neuro-evolution to shift and adjust the website in real-time based on the site’s current environment.

For the most part, though, Deep Learning systems are fueled by large data sets, and so the prospect of new and useful models being generated from large and unique datasets has fueled the misconception that…

 

4. It’s all about BIG data

It’s not. It’s actually about good data. Large, imbalanced datasets can be deceptive, especially if they only partially capture the data most relevant to the domain.

Data Management

Furthermore, in many domains, historical data can become irrelevant quickly.

In high-frequency trading in the New York Stock Exchange, for instance, recent data is of much more relevance and value than, for example, data from before 2001, when they had not yet adopted decimalization.

Finally, a general misconception I run into quite often:

 

6. If a system solves a problem that we think requires intelligence, that means it is using AI

This one is a bit philosophical in nature, and it does depend on your definition of intelligence. Indeed, Turing’s definition would not refute this.

data protection

However, as far as mainstream AI is concerned, a fully engineered system, say to enable self-driving cars, which does not use any AI techniques, is not considered an AI system.

If the behavior of the system is not the result of the emergent behavior of AI techniques used under the hood, if programmers write the code from start to finish, in a deterministic and engineered fashion, then the system is not considered an AI-based system, even if it seems so.

 

AI paves the way for a better future

Despite the common misconceptions around AI, the one correct assumption is that AI is here to stay and is indeed, the window to the future.

AI-Artificial Intelligence Benefits & Risks

AI still has a long way to go before it can be used to solve every problem out there and to be industrialized for wide-scale use.

Deep Learning models, for instance, take many expert PhD-hours to design effectively, often requiring elaborately engineered parameter settings and architectural choices depending on the use case.

Currently, AI scientists are hard at work on simplifying this task and are even using other AI techniques such as reinforcement learning and population-based or evolutionary architecture search to reduce this effort.

The next big step for AI is to make it be creative and adaptive, while at the same time, powerful enough to exceed human capacity to build models.

by Babak Hodjat, co-founder & CEO Sentient Technologies

Source: gigaom.com

Birds Flying in a Group

Voices in AI – Episode 50: A Conversation with Steve Pratt

In this episode, Byron and Steve discuss the present and future impact of AI on businesses.

Welcome

Byron Reese: This is Voices in AI, brought to you by GigaOm, and I’m Byron Reese. Today, our guest is Steve Pratt.

He is the Chief Executive Officer over at Noodle AI, the enterprise artificial intelligence company. Prior to Noodle, he was responsible for all Watson implementations worldwide, for IBM Global Business Services.

He was also the founder and CEO of Infosys Consulting, a Senior Partner at Deloitte Consulting, and a Technology and Strategy Consultant at Booz Allen Hamilton.

Consulting Magazine has twice selected him as one of the top 25 consultants in the world. He has a Bachelor’s and a Master’s in Electrical Engineering from Northwestern University and George Washington University. Welcome to the show, Steve.

Steve Pratt: Thank you. Great to be here, Byron.

 

Q: 1

Let’s start with the basics. What is artificial intelligence, and why is it artificial?

Artificial intelligence is basically any form of learning algorithm; is the way we think of things.

We actually think there’s a raging religious debate [about] the differences between artificial intelligence and machine learning, and data science, and cognitive computing, and all of that.

But we like to get down to basics, and basically say that they are algorithms that learn from data, and improve over time, and are probabilistic in nature.

Basically, it’s anything that learns from data and improves over time.

Data Virtualization

Q: 2

So, kind of by definition, the way that you’re thinking of it is it models the future, solely based on the past. Correct?

Yes. Generally, it models the future and sometimes makes recommendations, or it will sometimes just explain things more clearly. It typically uses four categories of data.

There are both internal data and external data and both structured and unstructured data. So, you can think of it kind of as a quadrant.

We think the best AI algorithms incorporate all four datasets because especially in the enterprise, where we’re focused, most of the business value is in the structured data.

But usually, unstructured data can add a lot of predictive capabilities, and a lot of signals, to come up with better predictions and recommendations.

Data Warehouse

Q: 3

How about the unstructured stuff? Talk about that for a minute. How close do you think we are?

When do you think we’ll have real, true unstructured learning, that you can kind of just point at something and say, “I’m going to Barbados. You figure it all out, computer.”

I think we have versions of that right now. I am an anti-fan of things like chatbots. I think that chatbots are very, very difficult to do, technically.

They don’t work very well. They’re generally very expensive to build. Humans just love to mess around with chatbots.

I would say in the scoring of business value and something that’s affordable and is easy to do, that chatbots are in the worst quadrant there.

I think there is a vast array of other things that actually add business value to companies, but if you want to build an intelligent agent using natural language processing, you can do some very basic things.

But I wouldn’t start there.

AI (ML/DL) Operations

Q: 4

Let me try my question slightly differently, then. Right now, the way we use machine learning is we say, “We have this problem that we want to solve.

How do you do X?” And we have this data that we believe we can tease the answer out of. We ask the machine to analyze the data, and figure out how to do that.

It seems the inherent limitations of that, though, it’s kind of all sequential in nature. There’s no element of transferred learning in that, where I grow exponentially what I’m able to do.

I just can do: “Yes. Another thing. Yes. Another. Yes. Another.” So, do you think this strict definition of machine learning, as you’re thinking of AI that way, is that a path to general intelligence?

Or is general intelligence like “No, that’s something way different than what we’re trying to do. We’re just trying to drive a car, without hitting somebody?”

General intelligence, I think, is way off in the future. I think we’re going to have to come up with some tremendous breakthroughs to get there.

I think you can duct-tape together a lot of narrow intelligence, and sort of approximate general intelligence, but there are some fundamental skills that computers just can’t do right now.

For instance, if I give a human the question, “Will the guinea pig population in Peru be relevant to predicting demand for tires in the U.S?” A human would say, “No, that’s silly.

Of course not.” A computer would not know that. A computer would actually have to go through all of the calculations, and we don’t have an answer to that question, yet.

So, I think generalized intelligence is a way off, but I think there are some tremendously exciting things that are happening right now, that are making the world a better place, in narrow intelligence.

AI-ML-Robotics Technologies

Q: 5

Absolutely. I do want to spend the bulk of our time there, in that world. But just to explore what you were saying, because there’s a lot of stuff to mine, in what you just said.

That example you gave about the guinea pigs is sort of a common-sense problem, right? In how it’s referred. “Am I heavier than the statue of liberty?”

How do you think humans are so good at that stuff? How is it that if I said, “Hey, what would an Oscar statue look like, smeared with peanut butter?”

You can conjure that up, even though you’ve never even thought of that before, or seen it covered, or seen anything covered with peanut butter.

Why are we so good at that kind of stuff, and machines seem amazingly ill-equipped at it?

I think humans have constant access to an incredibly diverse array of datasets. Through time, they have figured out patterns from all of those diverse datasets.

So, we are constantly absorbing new datasets. In machines, it’s a very deliberate and narrow process right now.

When you’re growing up, you’re just seeing all kinds of things. And as we go through our life, we develop these – you could think of them as regressions and classifications in our brains, for those vast arrays of datasets.

As of right now, machine learning and AI are given very specific datasets, crunch the data, and then make a conclusion. So, it’s somewhere in there. We’re not exactly sure, yet.

Artificial Intelligence-Machine Learning-Deep Learning Technologies

Q: 6

All right, the last question on general intelligence, and we’ll come back to the here and now. When I ask people about it, the range of answers I get is 5 to 500 years.

I won’t pin you down to a time, but it sounds like you’re “Yeah, it’s way off.” Yet, people who say that often usually say, “We don’t know how to do it, and it’s going to be a long time before we get it.”

But there’s always the implicit confidence that we can do it, that it is a possible thing. We don’t know how to do it. We don’t know how we’re intelligent.

We don’t know the mechanism by which we are conscious, or the mechanism by which we have a mind, or how the brain fundamentally functions, and all of that.

But we have a basic belief that it’s all mechanistic, so we’re going to eventually be able to build it. Do you believe that, or is it possible that general intelligence is impossible?

No. I don’t think it’s impossible, but we just don’t know how to do it, yet. I think transfer learning, there’s a clue in there, somewhere.

I think you’re going to need a lot more memory, and a lot more processing power, to have a lot more datasets in general intelligence.

But I think it’s way off. I think there will be stage gates, and there will be clues of when it’s starting to happen.

That’s when you can take an algorithm that’s trained for one thing, and have it – if you can take Alpha Go, and then the next day, it’s pretty good at Chess.

And the next day, it’s really good at Parcheesi, and the next day, it’s really good at solving mazes, then we’re on the track. But that’s a long way off.

Machine Learning and AI

Q: 7

Let’s talk about this narrow AI world. Let’s specifically talk about the enterprise. Somebody listening today is at, let’s say a company of 200 people, and they do something.

They make something, they ship it, they have an accounting department, and all of that. Should they be thinking about artificial intelligence now?

And if so, how? How should they think about applying it to their business?

A company that small, it’s actually really tough, because artificial intelligence really comes into play when it’s beyond the complexity that a human can fit in their mind.

Artificial-Intelligence-AI

Q: 8

Okay. Let’s up it to 20,000 people.

20,000? Okay, perfect. 20,000 people – there are many, many places in the organization where they absolutely should be using learning algorithms to improve their decision-making.

Specifically, we have 5 applications that focus on the supply side of the company; that’s in:

  • materials,
  • production,
  • distribution,
  • logistics,
  • and inventory.

And then, on the supply side, we have 5 areas also:

  • customer,
  • product,
  • price,
  • promotion,
  • and sales force.

All of those things are incredibly complex, and they are highly interactive.

Within each application area, we basically have applications that almost treat it like a game, although it’s much more complicated than a game, even though games like Go are very complex.

Each of our applications does, really, 4 things:

  • it senses,
  • it proposes,
  • it predicts,
  • and then it scores.

So, basically, it senses the current environment, it proposes a set of actions that you could take, it predicts the outcome of each of those actions – like the moves on a Chessboard – and then it scores it.

It says, “Did it improve?” There are two levels of that, two levels of sophistication. One is “Did it improve locally? Did it improve your production environment, or your logistics environment, or your materials environment?”

And then, there is one that is more complex, which says “If you look at that across the enterprise, did it improve across the enterprise?”

These are very, very complex mathematical challenges.

The difference is dramatic, from the way decisions are made today, which is basically people getting in meetings with imperfect data on spreadsheets and PowerPoint slides, and having arguments.

Plane Take Off

Q: 9

So, pick a department, and just walk me through a hypothetical or real use case where you have seen the technology applied, and have measurable results.

Sure. I can take the work we’re doing at XOJET, which is the largest private aviation company in the U.S. If you want to charter a jet, XOJET is the leading company to do that.

The way they were doing pricing before we got there was basically old, static rules that they had developed several years earlier. That’s how they were doing pricing.

What we did is we worked with them to take into account where all of their jets currently were, where all of their competitors’ jets are, what the demand was going to be, based on a lot of internal and external data; like what events were happening in what locations, what was the weather forecast, what [were] the economic conditions, what were historic prices and results?

And then, basically came up with all of the different pricing options they could come up with, and then basically made a recommendation on what the price should be. As soon as they put in our application, which was in Q4 of 2016, the EBITDA of the company, which is basically the net margin – not quite, but – went up 5%, to the company.

The next thing we did for them was to develop an application that looked at the balance in their fleet, which is: “Do you have the right jets in the right place, at the right time?”

This takes into account having to look at the next day. Where is the demand going to be the next day?

So, you make sure you don’t have too many jets in low-demand locations or not enough jets in high-demand locations.

We actually adjusted the prices, to create an economic incentive to drive the jets to the right place at the right time.

We also, again, looked at the competitive position, which is through Federal Aviation Administration data.

You can track the tail numbers of all of their jets, and all of the competitor jets, so you could calculate competitive position.

Then, based on that algorithm, the length of haul, which is the number of hours flown per jet, went up 11%.

This was really dramatic, and dramatically reduced the number of “deadheads” they were flying, which is the amount of empty jets they were flying to reposition their jets.

I think that’s a great success story. There’s tremendous leadership at that company, very innovative, and I think that’s really transformed their business.

DevOps & DataOps

Q: 10

That’s kind of a classic load-balancing problem, right? I’ve got all of these things, and I want to kind of distribute it and make sure I have plenty of what I need, where.

That sounds like a pretty general problem. You could apply it to package delivery or taxicab distribution, or any number of other things.

How generalizable is any given solution, like from that, to other industries?

That’s a great question. There are a lot of components that, that are generalizable. In fact, we’ve done that.

We have componentized the code and the thinking, and can rapidly reproduce applications for another client, based on that. There’s a lot of stuff that’s very specific to the client, and of course, the end application is trained on the client’s data.

So, it’s not applicable to anybody else. The models are specifically trained on the client data. We’re doing other projects in airline pricing, but the end result is very different because the circumstances are different.

But you hit on a key question, which is “Are things generalizable?” One of the other approaches we’re taking is around transferred learning, especially when you’re using deep learning technologies.

You can think of it as the top layers of a neural net can be trained on sort of general pricing techniques, and just the deeper layers are trained on pricing specific to that company.

That’s one of the other generalization techniques. Because AI problems in the enterprise generally have sparser datasets than if you’re trying to separate cat pictures from dog pictures.

So, data sparsity is a constant challenge. I think transfer learning is one of the key strategies to avoid that.

Data Management Strategy

Q: 11

You mentioned in passing, looking at things like games. I’ve often thought that was kind of a good litmus test for figuring out where to apply the technology, because games have points, and they have winners, and they have turns, and they have losers.

They have structure to them. If that case study you just gave us was a game, what was the point in that? Was it a dollar of profit?

Because you were like “Well, the plane could be, or it could fly here, where it might have a better chance to get somebody. But that’s got this cost.

It wears out the plane, so the plane has to be depreciated accordingly.” What is the game it’s playing? How do you win the game it’s playing?

That’s a really great question. For XOJET, we actually created a tree of metrics, but at the top of the tree is something called fleet contribution, which is “What’s the profit generated per period of time, for the entire fleet?”

Then, you can decompose that down to how many jets are flying, the length of haul, and the yield, which is the amount of dollars per hour flown.

There’s also, obviously, a customer relationship component to it. You want to make sure that you get really good customers, and that you can serve them well.

But there are very big differences between games and real-life business. Games have a finite number of moves.

The rules are well-defined. There’s generally, if you look at Deep Blue or Alpha Go, or Arthur Samuels, or even the Labradas. All of these were two-player games.

In the enterprise, you have typically tens, sometimes hundreds of players in the game, with undefined sets of moves. So, in the one sense, it’s a lot more complicated.

The idea is, how do you reduce it, so it is game-like? That’s a very good question.

 

Q: 12

So, do you find that most people come to you with a defined business problem, and they’re not really even thinking about “I want some of this AI stuff?

I just want my planes to be where they need to be.” What does that look like in the organization that brings people to you, or brings people to considering an artificial intelligence solution to a problem?

Typically, clients will see our success in one area, and then want to talk to us. For instance, we have a really great relationship with a steel company in Arkansas, called Big River Steel.

Big River Steel, we’re building the world’s first learning steel mill with them. Which will learn from their sensors, and be able to just do all kinds of predictions and recommendations.

It goes through that sense, propose, predict and score. It goes through that. So, when people heard that story, we got a lot of calls from steel mills.

Now, we’re kind of deluged with calls from steel mills all over the world, saying, “How did you do that, and how do we get some of it?”

Typically, people hear about us because of AI. We’re a product company, with applications, so we generally don’t go in from a consulting point of view, and say “Hey, what’s your business problem?”

We will generally go in and say, “Here are the ten areas where we have expertise and technology to improve business operations,” and then we’ll qualify a company if it applies or not.

One other thing is that AI follows the scientific methods, so it’s all about hypothesis, test, hypothesis, test. So it is possible that an AI application that works for one company will not work for another company.

Sometimes, it’s the datasets. Sometimes, it’s just a different circumstance. So, I would encourage companies to be launching lots of hypotheses, using AI.

Enterprise Data Governance with Modern Data Catalog Platforms: A GigaOm Research Byte

Q: 13

Your website has a statement quite prominently, “AI is not magic. It’s data.” While I wouldn’t dispute it, I’m curious.

What were you hearing from people that caused you to… or maybe hypothetically, – you may not have been in on it – but what do you think is the source of that statement?

I think there’s a tremendous amount of hype and B.S. right now out there about AI. People anthropomorphize AI. You see robots with scary eyes, or you see crystal balls, or you see things that – it’s all magic.

So, we’re trying to be explainers in chief, and to kind of de-mystify this, and basically say it’s just data and math, and supercomputers, and business expertise. It’s all of those four things, coming together.

We just happen to be at the right place in history, where there are breakthroughs in those areas. If you look at computing power, I would single that out as the thing that’s made a huge difference.

In April of last year, NVIDIA released the DGX-1, which is their AI supercomputer. We have one of those in our data center, that in our platform we affectionately call “the beast,” which has a petaflop of computing power.

If you put that into perspective, that the fastest supercomputer in the world in the year 2000, was the ASCI Red, which had one teraflop of computing power. There was only one in the world, and no company in the world had access to that.

Now, with the supercomputing that’s out there, the beast has 1,000 times more computing power than the ASCI Red did. So, I think that’s a tremendous breakthrough. It’s not magic. It’s just good technology.

The math behind artificial intelligence still relies largely on mathematical breakthroughs that happened in the ‘50s and ‘60s. And of course, Thomas Bayes,  who was a philosopher in the 1700s, with Bayes’ Theorem,

There’s been a lot of good work recently around different variations on neural nets. We’re particularly interested in long- and short-term memory, and convolutional neural nets.

But a lot of this is, a lot of the math has been around for a while. In fact, it’s why I don’t think we’re going to hit general intelligence any time soon.

Because it is true that we have had exponential growth in computing power, exponential growth in data. But it’s been a very linear growth in mathematics, right?

If we start seeing AI algorithms coming up with breakthroughs in mathematics, that we simply don’t understand, then I think the antennas can go up.

When Worlds Collide: Blockchain and Master Data Management

Q: 14

So, if you have your DGX-1, at a petaflop, and in five years, you get something that’s an exaflop – it’s 1,000 times faster than that – could you actually put that to use?

Or is it at some point, the jet company only has so much data? There are only so many different ways to crunch it.

We don’t really need more – we have, at the moment, all of the processor power we need. Is that the case? Or would you still pay dearly to get a massively faster machine?

We could always use more computing power. Even with the DGX-1. For instance, we’re working with a distribution company where we’re generating 500,000 models a day for them, crunching on massive amounts of data.

If you have massive datasets for your processing, it takes a while. I can tell you, life is a lot better. I mean, in the ‘90s, we were working on a neural net for the Coast Guard; to try to determine which ships off of the west coast were bad guys.

It was very simple neural nets. You would hit return, and it would usually crash. It would run for days and days and days and days, be very, very expensive, and it just didn’t work.

Even if it came up with an answer, the ships were already gone. So, we could always use more computing power. I think right now, a limitation is more on the data side of it, and related to the fact that they shouldn’t be throwing out data that they’re throwing out.

For instance, like customer relationship management systems. Typically, when you have an update to a customer, that it overwrites the old data. That is really, really important data.

I think coming up with a proper data strategy, and understanding the value of data, is really, really important.

 

Q: 15

What do you think, on this theme of AI is not magic, it’s data; when you go into an organization, and you’re discussing their business problems with them, what do you think are some of the misconceptions you hear about AI, in general?

You said it’s overhyped, and glowing-eyed robots and all of that. From an enterprise standpoint, what is it that you think people are often getting wrong?

I think there’s a couple of fundamental things that people are getting wrong. One is I think there is a tremendous over-reliance and over-focus on unstructured data, that people are falling in love with natural language processing, and thinking that that’s artificial intelligence.

While it is true that NLP can help with judging things like consumer sentiment or customer feedback, or trend analysis on social media, generally those are pretty weak signals. I would say, don’t follow the shiny object.

I think the reason people see that, is the success of Siri and Alexa, and people see that as AI. It is true that those are learning algorithms, and those are effective in certain circumstances.

I think they’re much less effective when you start getting into dialogue. Doing dialogue management with humans is extraordinarily difficult. Training the corpus of those systems is very, very difficult.

So, I would say stay away from chatbots and focus mostly on structured data, rather than unstructured data. I think that’s a really big one.

I also think that focusing on the supply side of a company is actually a much more fruitful area than focusing on the demand side, other than sales forecasting.

The reason I say that is that the interactions between inbound materials and production, and distribution, are more easily modeled and can actually make a much bigger difference.

It’s much harder to model things like the effect of a promotion on demand, although it’s possible to do a lot better than they’re doing now.

Or, things like customer loyalty; like the effect of general advertising on customer loyalty. I think those are probably two of the big areas.

Working Team

Q: 16

When you see large companies being kind of serious about machine learning initiatives, how are they structuring those in the organization?

Is there an AI department, or is it in IT? Who kind of “owns” it? How are its resources allocated?

Are there a set of best practices, that you’ve gleaned from it?

Yes. I would say there are different levels of maturity. Obviously, the vast majority of companies have no organization around this, and it is individuals taking initiatives, and experimenting by themselves.

IT in general has not taken a leadership role in this area. I think, fundamentally, that’s because IT departments are poorly designed. Like the CIO job needs to be two jobs.

There needs to be a Chief Infrastructure Officer and Chief Innovation Officer. One of those jobs is to make sure that the networks are working, the data center is working, and people have computers.

The other job is, “How are advances in technologies helping companies?” There are some companies that have Chief Data Officers.

I think that’s also caused a problem, because they’re focusing more on big data, and less on what do you actually do with those data?

I think the most advanced companies – I would say, first of all, it’s interesting because it’s following the same trajectory as information technology organizations follow, in companies. First, it’s kind of anarchy.

Then, there’s the centralized group. Then, it goes to a distributed group. Then, it goes to a federated group, federated meaning there’s a central authority that basically sets standards and direction.

But each individual business unit has its representatives.

So, I think we’re going to go through a whole bunch of gyrations in companies until we end up where most technology organizations are today, which is; there is a centralized IT function, but each business unit also has IT, people, in it.

I think that’s where we’re going.

Moving Time

Q: 17

And then, the last question along these lines: Do you feel that either:

A) machine learning is doing such remarkable things, and it’s only going to gain speed, and grow from here, or

B) machine learning is over-hyped to a degree that there are unrealistic expectations, and when disappointment sets in, you’re going to get a little mini AI winter again.

Which one of those has more truth?

Certainly, there is a lot of hype about it. But I think if you look at the reality of how many companies have actually implemented learning algorithms; AI, ML, data science, across the operations of their company, we’re at the very, very beginning.

If you look at it as a sigmoid, or an s-curve, we’re just approaching the first inflection point. I don’t know of any company that has fully deployed AI across all parts of its operations.

I think ultimately, executives in the 21stcentury will have many, many learning algorithms to support them, making complex business decisions.

I think the company that clearly has exhibited the strongest commitment to this, and is furthest along, is Amazon.

If you wonder how Amazon can deliver something to your door in one hour, it’s because there are probably 100 learning algorithms that made that happen, like where should the distribution center be?

What should be in the distribution center? Which customers are likely to order what? How many drivers do we need?

What’s the route the driver should take? All of those things are powered by learning algorithms.

And you see the difference, you feel the difference, in a company that has deployed learning algorithms.

I also think if you look back, from a societal point of view, that if we’re going to have ten billion people on the planet, we had better get a lot more efficient at the consumption of natural resources.

We had better get a lot more efficient at production.

I think that means moving away from static business rules that were written years ago, that are only marginally relevant to learning algorithms that are constantly optimizing.

And then, we’ll have a chance to get rid of what Hackett Group says is an extra trillion dollars of working capital, basically inventory, sitting in companies.

And we’ll be able to serve customers better.

Factory

Q: 18

You seem like a measured person, not prone to wild exaggeration. So, let me run a question by you. If you had asked people in 1995 if you had said this, “Hey, you know what?

If you take a bunch of computers, just PCs, like everybody has, and you connected them together, and you got them to communicate with hypertext protocol of some kind, that’s going to create trillions and trillions and trillions and trillions and trillions of dollars of wealth.”

“It’s going to create Amazon and Google and Uber and eBay and Etsy and Baidu and Alibaba, and millions of jobs that nobody could have ever imagined.

And thousands of companies. All of that, just because we’re snapping together a bunch of computers in a way that lets them talk to each other.”

That would have seemed preposterous. So, I ask you the question; is artificial intelligence, even in the form that you believe is very real, and what you were just talking about, is it an order of magnitude bigger than that?

Or is it that big, again? Or is it like “Oh, no? Just snapping together, a bunch of computers, pales to what we are about to do.”

How would you put your anticipated return on this technology, compared to the asymmetrical impact that this seemingly very simple thing had on the world?

I don’t know. It’s really hard to say. I know it’s going to be huge. Right? It is fundamentally going to make companies much more efficient. It’s going to allow them to serve their customers better.

It’s going to help them develop better products. It’s going to feel a lot like Amazon, today, is going to be the baseline of tomorrow. And there’s going to be a lot of companies that – I mean, we run into a lot of companies right now that just simply resist it.

They’re going to go away. The shareholders will not tolerate companies that are not performing up to competitive standards.

The competitive standards are going to accelerate dramatically, so you’re going to have companies that can do more with less, and it’s going to fundamentally transform business. You’ll be able to anticipate customer needs.

You’ll be able to say, “Where should the products be? What kind of products should they be? What’s the right product for the right customer? What’s the right price? What’s the right inventory level?

How do we make sure that we don’t have warehouses full of billions and billions of dollars worth of inventory?”

It’s very exciting. I think the business, and I’m generally really bad at guessing years, but I know it’s happening now, and I know we’re at the beginning.

I know it’s accelerating. If you forced me to guess, I would say, “10 years from now, Amazon of today will be the baseline.” It might even be shorter than that.

If you’re not deploying hundreds of algorithms across your company, that is constantly optimizing your operations, then you’re going to be trailing behind everybody, and you might be out of business.

Distributor

Q: 19

And yet my hypothetical 200-person company shouldn’t do anything today. When is the technology going to be accessible enough that it’s sort of in everything?

It’s in their copier, and it’s in their routing software. When is it going to filter down, so that it really permeates kind of everything in business?

The 200-person company will use AI, but it will be in things like I think database design will change fundamentally.

There is some exciting research right now, actually using predictive algorithms to fundamentally redesign database structures so that you’re not actually searching the entire database; you’re just searching most likely things first.

Companies will use AI-enabled databases, they’ll use AI in navigation, they’ll use AI in route optimization. They’ll do things like that.

But when it comes down to it, for it to be a good candidate for AI, in helping make complex decisions, the answer needs to be non-obvious.

Generally with a 200-person company, having run a company that went from 2 people to 20 people, to 200 people, to 2,000 people, to 20,000 people, I’ve seen all of the stages.

A 200-person company, you can kind of brute force. You know everybody. You’ve just crossed Dunbar’s number, so you kind of know everything that’s going on, and you have a good feel for things.

But like you said, I think applying it in using other peoples’ technologies that are driven by AI, for the things that I talked about, will probably apply to a 200-person company.

Authorized Dealer

Q: 20

With your jet company, you did a project, and EBITDA went up 5%, and that was a big win.

That was just one business problem you were working on. You weren’t working on where they buy jet fuel, or where they print. Nothing like that.

So presumably, over the long haul, the technology could be applied in that organization, in a number of different ways.

If we have a $70 trillion economy in the world, what percent is – 5% is easy – what percentage improvement do you think we’re looking at?

Like just growing that economy dramatically, just by the efficiencies that machine learning can provide?

Wow. The way to do that is to look at an individual company, and then sort of extrapolating. I would say an individual company could if you look at the value of companies.

That’s the way I look at it, like shareholder value, which is made up of revenue, margins, and capital efficiency. I think that revenue growth could take off, could probably double, from what it is.

The growth could double from what it is now. And the margins will have a dramatic impact.

I think you could, if you look at all of the different things you could do within the company, and you had fully deployed learning algorithms, and gotten away from making decisions on yardsticks and averages, you could, a typical company, I’ll say double your margins.

But the home run is in capital efficiency, which not too many people pay attention to, and is one of the key drivers of return on invested capital, which is the driver of general value.

This is where you can reduce things by 30%, things like that, and get rid of warehouses of stuff.

That allows you to be a lot more innovative because then you don’t have obsolescence. You don’t have to push products that don’t work. You can develop more innovative products.

There are a lot of good benefits. Then, you start compounding that year over year, and pretty soon, you’ve made a big difference.

Q: 21

Right, because doubling margins alone doubles the value of all of the companies, right?

It would if you projected it out over time. Yes. All else being equal.

Vending Machine

Q: 22

Which it seldom is. It’s funny, you mentioned Amazon earlier.

I just assumed they had a truck with a bunch of stuff on it, that kept circling my house because it’s like every time I want something, they’re just there, knocking on the door.

I thought it was just me!

Yeah. Amazon Prime now came out, was it last year? In the Bay Area?

My daughter ordered a pint of ice cream and a tiara. An hour later, a guy is standing at the front door with a pint of ice cream and a tiara. It’s like wow!

 

Q: 23

What a brave new world, that has such wonders in it!

Exactly!

 

Q: 24

As we’re closing up on time here, there are a number of people that are concerned about this technology. Not in the killer robot scenario.

They’re concerned about automation; they’re concerned about – you know it all. Would you say that all of this technology and all of this growth, and all of that, is good for workers and jobs?

Or it’s bad, or it’s disruptive in the short term, not in the long term? How do you size that up for somebody who is concerned about their job?

First of all, moving sort of big picture to small picture, first of all, this is necessary for society, unless we stop having babies.

We need to do this, because we have finite resources, and we need to figure out how to do more with less. I think the impact on jobs will be profound. I think it will make a lot of jobs a lot better. In AI, we say it’s augmented, amplify and automate.

Right now, like the things we’re doing at XOJET really help make the people in revenue management a lot more powerful, and I think, enjoy their jobs a lot more, and doing a lot less routine research and grunt work.

So, they actually become more powerful, it’s like they have superpowers.

I think that there will also be a lot of automation. There are some tasks that AI will just automate and just do, without human interaction.

A lot of decisions, in fact, most decisions, are better if they’re made with an algorithm and a human, to bring out the best of both. I do think there’s going to be a lot of dislocation.

I think it’s going to be very similar to what happened in the automotive industry, and you’re going to have pockets of dislocation that are going to cause issues.

Obviously, the one that’s talked about the most is the driverless car.

If you look at all of the truck drivers, I think probably within a decade, that most cross-country trucks, there’s going to be some person sitting in their house, in their pajamas, with nine screens in front of them, and they’re going to be driving nine trucks simultaneously, just monitoring them.

And that’s the number one job of adult males in the U.S. So, we’re going to have a lot of displacement. I think we need to take that very seriously and get ahead of it, as opposed to chasing it, this time.

But I think overall, this is also going to create a lot more jobs because it’s going to make more successful companies. Successful companies hire people and expand, and I think there are going to be better jobs.

The Marketing Team Illustration

Q: 25

You’re saying it all eventually comes out in the wash; that we’re going to have more, better jobs, and a bigger economy, and that’s broadly good for everyone.

But there are going to be bumps in the road, along the way. Is that what I’m getting from you?

Yes. I think it will actually be a net positive. I think it will be a net significant positive. But it is a little bit of, as economists would say, “creative destruction.”

As you go from agricultural to industrial, to knowledge workers, toward sort of an analytics-driven economy, there are always massive disruptions.

I think one of the things that we really need to focus on is education, and also on trade schools.

There is going to be a lot larger need for plumbers and carpenters and those kinds of things.

Also, if I were to recommend what someone should study in school, I would say study mathematics. That’s going to be the core of the breakthroughs, in the future.

Outsourcing Marketing

Q: 26

That’s interesting. Mark Cuban was asked that question, also. He says the first trillionaires are going to be in AI.  

And he said philosophy. Because in the end, what you’re going to need are what the people know how to do.

Only people can impute value, and only people can do all of that.

Wow! I would also say behavioral economics; understanding what humans are good at doing, and what humans are not good at doing.

We’re big fans of Kahneman and Tversky, and more recently, Thaler.

When it comes down to how humans make decisions, and understanding what skills humans have, and what skills algorithms have, it’s very important to understand that, and to optimize that over time.

A Leader

Q: 27

All right. That sounds like a good place to leave it. I want to thank you so much for a wide-ranging show, with a lot of practical stuff, and a lot of excitement about the future. Thanks for being on the show.

My pleasure. I enjoyed it. Thanks, Byron.

Byron explores issues around artificial intelligence and conscious computers in his new book The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity.

Source: gigaom.com