淺談人工智能的下個(gè)十年

淺談人工智能的下個(gè)十年人工智能的第三次浪潮人工智能歷史人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyClaudeShannonShannon,ClaudeE."XXII.Programmingacomputerforplayingchess."Philosophicalmagazine41.314(1950):256-275.AlanTuringTuring,AlanM."Solvableandunsolvableproblems."ScienceNews-ens.fr39(1954).1950計(jì)算機(jī)象棋博弈1954圖靈測(cè)試人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyJohnMcCarthyMcCarthy,J.,etal."DartmouthConference."DartmouthSummerResearchConferenceonArtificialIntelligence.19561956達(dá)特茅斯會(huì)議1959一般問題解決器MarvinMinskyNathanRochesterClaudeShannonHerbert

SimonJ.C.ShawAllen

NewellNewell,A.;Shaw,J.C.;Simon,H.A.(1959).Reportonageneralproblem-solvingprogram.ProceedingsoftheInternationalConferenceonInformationProcessing.pp.256–264.人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyDanielBobrowBobrow,DanielG."Naturallanguageinputforacomputerproblemsolvingsystem."(1964)JosephWeizenbaumWeizenbaum,Joseph."ELIZA—acomputerprogramforthestudyofnaturallanguagecommunicationbetweenmanandmachine."CommunicationsoftheACM9.1(1966):36-45.1964

理解自然語言輸入1966ELIZA人機(jī)對(duì)話人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyBuchanan,Bruce,GeorgiaSutherland,andEdwardA.Feigenbaum.HeuristicDENDRAL:aprogramforgeneratingexplanatoryhypothesesinorganicchemistry.DefenseTechnicalInformationCenter,1968.1968

世界首個(gè)專家系統(tǒng)DENDRALEdwardFeigenbaum人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyRandallDavisApplicationsofmetalevelknowledgetotheconstruction,maintenanceanduseoflargeknowledgebases[M].StanfordUniversity,ComputerScienceDepartment,AILaboratory,1976.DrewMcDermott,JonDoyleMcDermottD,DoyleJ.Non-monotoniclogicI[J].Artificialintelligence,1980,13(1):41-72.1976大規(guī)模知識(shí)庫構(gòu)建與維護(hù)1980非單調(diào)邏輯人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyBerlinerHJ.Backgammoncomputerprogrambeatsworldchampion[J].ArtificialIntelligence,1980,14(2):205-220.1980

計(jì)算機(jī)戰(zhàn)勝雙陸棋世界冠軍HansBerliner人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyBrooksR.Arobustlayeredcontrolsystemforamobilerobot[J].RoboticsandAutomation,IEEEJournalof,1986,2(1):14-231987基于行為的機(jī)器人學(xué)RodneyBrooks人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyTesauroG.TD-Gammon,aself-teachingbackgammonprogram,achievesmaster-levelplay[J].Neuralcomputation,1994,6(2):215-219.1987自我學(xué)習(xí)雙陸棋程序GerryTesauro人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyTimBerners-Lee

Berners-Lee,Tim."Semanticwebroadmap."(1998).McGuinness,DeborahL.,andFrankVanHarmelen."OWLwebontologylanguageoverview."W3Crecommendation10.2004-03(2004):10.1998

語義互聯(lián)網(wǎng)路線圖2004OWL語言人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyGeoffreyHinton

Hinton,GeoffreyE.,SimonOsindero,andYee-WhyeTeh."Afastlearningalgorithmfordeepbeliefnets."

Neuralcomputation

18.7(2006):1527-1554.Le,QuocV.,etal."Buildinghigh-levelfeaturesusinglargescaleunsupervisedlearning."

arXivpreprintarXiv:1112.6209

(2011).2006

深度學(xué)習(xí)2011

高層抽象特征構(gòu)建人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyMarkoff,John."Googlecarsdrivethemselves,intraffic."TheNewYorkTimes10(2010):A1.2009谷歌自動(dòng)駕駛汽車SebastianThrun人工智能領(lǐng)域發(fā)展趨勢(shì)PoweredbyIBM’sWatsonMarkoff,John."Computerprogramtotakeon‘Jeopardy!’."TheNewYorkTimes(2009).Apple’sSiriSadun,Erica,andSteveSande.TalkingtoSiri:LearningtheLanguageofApple'sIntelligentAssistant.QuePublishing,2013.2011沃森獲得Jeopardy冠軍2011

自然語言問答人工智能領(lǐng)域發(fā)展趨勢(shì)Poweredby人工智能近10年AI趨勢(shì)：從感知到認(rèn)知FromperceptrontocognitionComputingPerceptionCognitionStorage&ComputingRecognizetext,images,objects,voicesOrganizeandgenerateknowledge,reasoningArtificialIntelligenceAlphaGoImagerecognitionSelf-driving算法BERTPre-trainFinetuneBeatallstate-of-the-artson11NLPtasksin2018/pdf/1810.04805.pdfXLNetAutoregressiveModelBeatBERTin2019/pdf/1906.08237.pdfALBERTALiteBERTParameter-reductiontechniquesBeatXLNetandalltheothers/pdf/1909.11942.pdfVideo-to-VideoSynthesisThebestvideosynthesisperformance/abs/1808.06601graph_netByDeepMind/abs/1806.01261MoCoUnsupervised

visual

representation

learningMomentum

contrastive

learningOutperform

its

supervised

pre-training

counterparts/abs/1911.05722SimCLRSimplified

contrastive

learning

frameworkOutperform

previous

self-supervised

and

semi-supervised

methods

on

ImageNet/abs/2002.05709人工智能未來…第三代人工智能的理論體系早在2015年，張鈸老師就提出第三代人工智能體系的雛形；2017年DARPA發(fā)起XAI項(xiàng)目，從可解釋的機(jī)器學(xué)習(xí)系統(tǒng)、人機(jī)交互技術(shù)以及可解釋的心理學(xué)理論三個(gè)方面，全面開展可解釋性AI系統(tǒng)的研究2018年底，正式公開提出第三代人工智能的理論框架體系建立可解釋、魯棒性的人工智能理論和方法發(fā)展安全、可靠、可信及可擴(kuò)展的人工智能技術(shù)推動(dòng)人工智能創(chuàng)新應(yīng)用具體實(shí)施路線圖與腦科學(xué)融合，發(fā)展腦啟發(fā)的人工智能理論數(shù)據(jù)與知識(shí)融合的人工智能理論與方法第三代人工智能的理念在國內(nèi)外

獲得廣泛影響力認(rèn)知圖譜(CognitiveGraph)

—知識(shí)圖譜,認(rèn)知推理,邏輯表達(dá)知識(shí)圖譜“Knowledgegraph”由Google于2012年提出知識(shí)工程，專家系統(tǒng)CYC:世界上歷史最長的AI項(xiàng)目(1985)Tim

Berners

LeeFatherofWWWTuringAwardEdward

FeigenbaumFatherofKBTuringAward認(rèn)知圖譜：算法與認(rèn)知的結(jié)合TheQualityCafeisanow-defunctdinerinLosAngeles,California.TherestauranthasappearedasalocationfeaturedinanumberofHollywoodfilms,includingOldSchool,Gonein60Seconds,...QualityCaféLosAngelesisthemostpopulouscityinCalifornia,thesecondmostpopulouscityintheUnitedStates,afterNewYorkCity,andthethirdmostpopulouscityinNorthAmerica.Los

AngelesOldSchoolisa2003AmericancomedyfilmreleasedbyDream

WorksPicturesandTheMontecitoPictureCompanyanddirectedbyToddPhillips.Old

SchoolToddPhillipsisanAmericandirector,producer,screenwriter,andactor.Heisbestknownforwritinganddirectingfilms,includingRoadTrip(2000),OldSchool(2003),Starsky&Hutch(2004),andTheHangoverTrilogy.Todd

PhillipsAlessandroMoschittiisaprofessoroftheCSDepartmentoftheUniversityofTrento,Italy.HeiscurrentlyaPrincipalResearchScientistoftheQatarComputingResearchInstitute(QCRI)Alessandro

MoschittiTsinghua

UniversityTsinghuaUniversityisamajorresearchuniversityinBeijinganddedicatedtoacademicexcellence

andglobaldevelopment.TsinghuaisperenniallyrankedasoneofthetopacademicinstitutionsinChina,Asia,andworldwide...算法:BIDAF,BERT,XLNet目標(biāo)：理解整個(gè)文檔，而不僅僅是局部片段但仍然缺乏在知識(shí)層面上的推理能力BiDAFBERTXLNet挑戰(zhàn):可解釋性大部分閱讀理解方法都只能看做黑盒:輸入:問題和文檔輸出:答案文本塊(在文檔中的起止位置)如何讓用戶可以驗(yàn)證答案的對(duì)錯(cuò):推理路徑或者子圖每個(gè)推理節(jié)點(diǎn)上的支撐事實(shí)用于對(duì)比的其他可能答案和推理路徑認(rèn)知圖譜:知識(shí)表示,推理和決策和認(rèn)知科學(xué)的結(jié)合Dual

Process

Theory(CognitiveScience)

System1IntuitiveSystem2AnalyticFromBengio’sNIPS’2019KeynoteReasoningw/CognitiveGraphSystem

1:Knowledgeexpansion

by

association

in

text

when

readingSystem

2:Decisionmakingw/alltheinformationSystem1IntuitiveSystem2AnalyticCogQA:CognitiveGraphforQAAn

iterative

framework

corresponding

to

dual

process

theorySystem

1extract

entities

to

build

the

cognitive

graphgenerate

semantic

vectors

for

each

nodeSystem

2Do

reasoning

based

on

semantic

vectors

and

graphFeed

clues

to

System

1

to

extract

next-hop

entitiesQuestionQuality

caféTodd

PhillipsGone

in

60

secondsOld

schoolLos

AngelesDominic

SenaSystem

1System

2Cognitive

Graph…locationfeaturedinanumberofHollywoodfilms,includingOldSchoo