General Diffusion

GeneralDiffusionisbuildingthescienceeveryfrontierrequires.

WeWearearepursuingpursuingaacentralcentralquestion:question:cancanmachinesmachineslearnlearntotounderstandunderstandcomputationcomputationthethewaywaythetheworld'sworld'sbestbesthardwarehardwareengineersengineersdo?do?EveryEveryfrontierfrontierhumanityhumanityisisbettingbettingonondependsdependsononheterogeneousheterogeneouscomputecomputediversediverseprocessorsprocessorsworkingworkingsimultaneouslysimultaneouslyPhysicalPhysicalAI,AI,fusionfusionenergy,energy,precisionprecisionmedicine,medicine,autonomousautonomousvehicles,vehicles,sovereignsovereigndefense,defense,spacespacesystems,systems,superintelligence.superintelligence.NoNointelligenceintelligencelayerlayerexistsexiststotoorchestrateorchestrateit.it.GeneralGeneralDiffusionDiffusionisisbuildingbuildingthatthatlayer.layer.

TheThenextnextgenerationgenerationofofsupercomputesupercomputeisisheterogeneous:heterogeneous:CPU,CPU,GPU,GPU,ASIC,ASIC,andandFPGAFPGAoperatingoperatingsimultaneouslysimultaneouslyatatgigawattgigawattscale.scale.TodayTodaythatthathardwarehardwareisisorchestratedorchestratedbybyarmiesarmiesofofhumanhumanspecialists.specialists.TheTheefficiencyefficiencylostlostininthethegapgapthetheMismatchMismatchTaxTaxisis70%,70%,measuredmeasuredacrossacrossproductionproductionAIAIinfrastructureinfrastructureandandindependentlyindependentlyvalidated.validated.AtAt$200B+$200B+ininannualannualAIAIinfrastructureinfrastructurespend,spend,thatthatisisoverover$140$140billionbillionwastedwastedeveryeveryyear,year,andandititgrowsgrowswithwitheveryeverynewnewchipchiparchitecture.architecture.

EveryEverypriorpriorapproachapproachbuildsbuildsthethebrainbrainfirstfirstandandthenthenfightsfightstotomakemakeititrunrunononthethehardware.hardware.GeneralGeneralDiffusionDiffusioninvertsinvertsthis.this.OurOurfoundationfoundationmodelsmodelslearnlearnthethephysicsphysicsofofthetheprocessorsprocessorstheytheyrunrunononthethe"ChatGPT"ChatGPTmoment"moment"forforeveryeveryfrontierfrontierthatthatdependsdependsononheterogeneousheterogeneouscompute.compute.NoneNoneofofthemthemcancanbuildbuildthis.this.AllAllofofthemthemneedneedit.it.

SuperintelligenceSuperintelligencewillwillnotnotemergeemergefromfrombiggerbiggermodelsmodelsororfasterfasterchipschipsalone.alone.ItItwillwillemergeemergewhenwhenthethecomputecomputethosethosemodelsmodelsrunrunononisisfinallyfinallyasasintelligentintelligentasasthethemodelsmodelsthemselves.themselves.ThatThatisisthetheproblemproblemGeneralGeneralDiffusionDiffusionisissolving.solving.

ComputationComputationacrossacrossphysicallyphysicallyheterogeneousheterogeneoushardwarehardwareobeysobeyslearnablelearnablelaws.laws.WeWeareareestablishingestablishingthosethoselawslawsadvancingadvancingthetheco-evolutionco-evolutionofofheterogeneousheterogeneouscomputationcomputationandandintelligence.intelligence.