学科分类
/ 8
158 个结果
  • 简介:TheLHCexperimentsatCERNwillgeneratehugevolumesofdata-severalPBperyearatdataratesbetween100MB/sand1.5GB/s.Thestorageandanalysisofthesedatapresentamajorchallenge.IncollaborationwithothermembersoftheformerRD45project,thecentraldatabasesupportgroupatCERNhasbeenworkingonthisissueforseveralyears,leadingtoproductionuseofapotentialsolution,basedonthecombinationofanObjectDatabaseandMassStoragesystem,botheatCERNandoutside.

  • 标签: LHC实验 数据分析 数据存储
  • 简介:Thefastturnoverofsoftwaretechnologies,inparticularinthedomainofinteractivity(coveringuserinterfaceandvisualisation)makesitdifficultforasmallgroupofpeopletoproducecompleteandpolishedsoftware-toolsbeforetheunderlyingtechnologiesmakethemobsolete.AttheHepVis'99workshop,aworkinggrouphasbeenformedtoimprovetherpoductionofsoftwaretoolsfordataanalysisinHENP.Besidepromotingadistributeddevelopmentorganisation,onegoalofthegroupistosystematicallydesignasetofabstractinterfacesbasedonusingmodernOOanalysisandOOdesigntechniques.Aninitialdomainanalysishascomeupwithseveralcategories(componets)foundintypicaldataanalysistools:historams,Ntuples,Functions,Vectors,Fitter,Plotter,AnalyzerandController,SpecialEmphasiswasputonreducingthecouplingsbetweenthecategoriestoaminimum,thusoptimisingre-useandmaintainabilityofanycomponentindividually.TheinterfaceshavebeendefinedinJavaandC++andimplementationsexistintheformoflibrariesandtoolsusingC++(Anaphe/Lizard,Openscientist)andJava(JavaAnalysisStudio),AspecialimplementationaimsataccessingtheJavaLiraries(throughtheirAbstractInterfaces)fromC++.ThispapergiveranoverviewofthearchitectureanddesignofthevariouscomponentsfordataanalysisasdiscussedinAIDA.

  • 标签: 软件开发 数据分析 数据分析工具 HENP
  • 简介:Since1998,theALICEexperimentandtheCERN/ITdivisionhavejointlyexecutedseverallarge-scalehighthroughputdistributedcomputingexercises:theALICEdatachallenges.ThegoalsoftheseregularexercisesaretotesthardwareandsoftwarecomponentsofthedataacqusitionandcomputingsystemsinrealisticconditionsandtoexecuteanearlyintegrationoftheoverallALICEcomputinginfrastructure.ThispaperreportsonthethirdALICEDataChallenge(ADCIII)thathasbeenperformedatCERNfromJanuarytoMarch2001.ThedatausedduringtheADCⅢaresimulatedphysicsrawdataoftheALICETPC,producedwiththeALICEsimulationprogramAliRoot.ThedataacquisitionwasbasedontheALICEonlineframeworkcalledtheALICEDataAcquisitionTestEnvironment(DATE)system.Thedataaftereventbuilding,werethenformattedwiththeROOTI/OpackageandadatacataloguebasedonMySQlwasestablished.TheMassStorageSystemusedduringADCIIIisCASTOR.Differentsoftwaretoolshavebeenusedtomonitortheperformances,DATEhasdemonstratedperformancesofmorethan500MByte/s.Anaggregatedatathroughputof85MByte/swassutainedinCASTORoverseveraldays.Thetotalcollecteddataamountsto100TBytesin100.00files.

  • 标签: 软件开发 AliROOT CASTOR 质量存储系统
  • 简介:Inthispaperwepresentanoverviewoftheongoingstudiestobuildupaframeworkthatsupportstheanalysisafterthereprocessingphase.ThisframeworkaimstodevelopastandarddataquerylanguagefortheHEPcommunity,Therelatedstudieshavebeenconsideringtherelationaldatabasemodelaspossibleapproachopposedtotheobjectmodel.SeveraloptimizingandtunningtechniquesarebeingusedintechnologieslikeDB2[3],Oracle[5]andRoot[2],thataresimultaneouslybeingevaluated.TheexperienceobtainedcanbeseenasavaluabletestbedforthefutureLHCandsimultaneouslyasinterestinginputforthedevelopmentoftheGRID.

  • 标签: 关系数据库 数据分析 GRID 高能物理实验
  • 简介:ThemaingoaloftheHyperCP(E87)experimentatFermilabistosearchforCPviolationinΞandΑdecaysatthe-10^-4level.Thislevelofprecisiondictatesadatasampleofoverabillionevents.Theexperimentcollectedabout231billionraweventsonabout30,0005-GBtapesintenmonthsofrunningin1997and1999,Inordertoanalyzethishugeamountofdata,thecollaborationhasreconstructedtheeventsonafarmof55dual-processorLinux-basedPCsatFermilab.AsetoffarmtoolshasbeenwrittenbythecollaborationtointerfacewiththeFarmBatchSystem(FBSandFBSNG)[1]developedbytheFermilabComputingDivision,toautomatemuchofthefarmingandtoallownonexpertfarmshifterstosubmitandmonitorjobsthroughaweb-basedinterface.Specialcarehasbeentakentoproducearobustsystemwhichfacilitateseasyrecoveryfromerrors.Thecodehasprovisionsforextensivemonitoringofthedataonaspill-by-spillbasis,asisrequiredbytheneedtominimizepotentialSystematicerrors.About36millionplotsofvariousparametersproducedfromthefarmanalysiscanbeaccessedthroughadatamanagementsystem.Theentiredatasetwasfarmedinelevenmouths,oraboutthesametimethatwastakentoacquirethedata.Wewilldescribethearchitectureofthefarm.ourexperienceinoperatingit,andshowsomeresultsfromthefarmanalysis.

  • 标签: HyperCP实验 Fermi实验室 CP破坏
  • 简介:时空单极方程是在到ℝ2,1的ℝ2,2的anti-self-dualYang工厂方程的减小。这个方程是一个非线性的波浪方程,并且能被编码为宽松的对。相等的宽松的对被奶妈和Terng使用与连续散布数据构造单极,然后方程能被散布数据线性化,允许一个使用散布方法解决有很快腐烂的Cauchy问题的逆小起始的数据。在这篇论文,我们使用holomorphic捆的术语和某些地图的transversality,由起始的数据的parametrized,多达计量转变给更起始的数据,我们能与使用散布方法解决单极方程的Cauchy问题。

  • 标签: 单极式 非线性波动方程 Cauchy问题 LAX对 逆散射 线性方程
  • 简介:InthispaperwehighlightstrategiesandchoicesthatmaketheDφDataHandlingsystemmarkedlydifferentfrommanyotherexperiments'systems,WeemphasizehowfartheDφsystemhascomeininnovatingandimplementingaDφ-specificDataGridsystem.Wediscussexperiencesduringthefirstmonthsofdetectorcommissioningandgivesomefutureplansforthesystem.

  • 标签: Dφ实验 数据处理系统 探测器
  • 简介:Semiparametrictransformationmodelsprovideaclassofflexiblemodelsforregressionanalysisoffailuretimedata.Severalauthorshavediscussedthemunderdifferentsituationswhencovariatesaretimeindependent(Chenetal.,2002;Chengetal.,1995;Fineetal.,1998).Inthispaper,weconsiderfittingthesemodelstoright-censoreddatawhencovariatesaretime-dependentlongitudinalvariablesand,furthermore,maysuffermeasurementerrors.Forestimation,weinvestigatethemaximumlikelihoodapproach,andanEMalgorithmisdeveloped.Simulationresultsshowthattheproposedmethodisappropriateforpracticalapplication,andanillustrativeexampleisprovided.

  • 标签: 故障时间 测量误差 协变量 联合建模 纵向数据 模型数据
  • 简介:AsaresultofdiscussionswithintheHEPcommunity,wehavewrittenaC++packagewhichcanbeusedtomaintainatableofparticleproperties,includingdecaymodeinformation.Theclassesallowformultipletablesandacceptinpufromanumberofstandardsources,Inaddition,Theyprovideamechanismbywhichaneventgeneratorcanemploythetabulatedinformationtoactuallydirectthedecayofparticles.

  • 标签: HepPDT 粒子数据表 高能物理
  • 简介:UpgradeofGoosyDataAcquisitionSystem¥WangShujin;WangYanyu;XingJianping;GuoTianruiandJiaoDunpangAdataacquisitionsystemnamedGoos...

  • 标签:
  • 简介:在自然、社会的科学的许多实际系统能被动态网络描述。一天一天地,我们测量了并且从这些网络积累了数据的巨大的数量,它能被我们使用推进我们世界的理解。生产这些数据的网络的结构经常是未知的。因而,从可得到的数据理解这些网络的结构转弯是学科交差的域里的中央问题之一,它被称为网络重建问题。在这份报纸,我们用数据可获得性不为常规网络重建是足够的部分可得到的数据和一些状况考虑了网络重建的问题。而且,我们建议与仅仅可得到的子网和隐藏的全部网络的另外的节点的数据推断子网;与一些可得到的节点变量的一般水准在网络描绘组组相互作用;并且网络被未知内部快变化的噪音和未知外部慢慢地变化的信号驾驶仅仅,与节点变量的已知的数据执行网络重建。所有这些状况被期望在实际系统和方法普通,结果可能为真实世界应用是有用的。

  • 标签: 动态网络 节点数据 实际系统 网络结构 社会科学 自然科学
  • 简介:TheBaBardataacquisitionsystem(DAQ)transportsdatafromthedetectorfrontendeletronicstoshorttermdiskstorage.Amonitoringapplication(VMON)hasbeendevelopedtomonitortheonehundredandninetycomputersinthedataflowsystem.PerformanceinformationforeachCPUiscollectedandmulticastacrosstheexistingdatatransportnetwork.ThepacketsarecurrentlycollectedbyasingleUNIXworkstationandarchived.AROOTbasedGUIprovidescontrolanddisplaystheDAQperformanceinrealtime.ThesameGUIisreusedtorecoverarchivedVMONdata,VMONhasbeendeployedandconstantlymonitorstheBaBardataflowsystem.Ithasbeenusedfordiagnosticsandprovidesinputtomodelsprojectingfutureperformance.Theapplicationhasnomeasurableimpactondatataking,respondsinstantaneouslyonthehumantimescaletorequestsforinformationdisplay,andusesonly3%ofa300MHzSunUltra5CPU.

  • 标签: BaBar实验 数据传输 探测器
  • 简介:TheCDFexperimentstarteddatatakinginApril2001,Thedataareorganizedintodatasetswhichcontaineventsofsimilarphysicspropertiesandreconstructionversion.theinformationaboutdatasetsisstoredintheDataFileCatalog,arelationaldatabase.Thisinformationispresentedtothedataprocessingframeworkasobjectswhichareretrievedusingcompoundkeys.Theobjectsandthekeysaredesignedtobethealgorithms'viewofinformationstoredinthedatabase.ObjectsmayuseseveralDBtables.Adatabaseinterfacemanagementlayerexistsforthepurposeofmanagingthemappingofpersistentdatatotransientobjectsthatcanbeusedbytheframework.Thislayerexistsbetweenthealgorithmcodeandthecodewhichreadsdirectlyfromdatanbasetables.Attheuserend,itplacesget/putinterfaceonatopofatransientclassforretrievalorstorageofobjectsofthisclassusingakey.DataFileCatalogcodemakesuseofthisfacilityandcontainsallthecodeneededtomanipulateCDFDataFileCatalogfromaC++programorfromthecommandprompt,ItsupportsanOracleinterfaceusingOTL,andamSQLinterface,ThiscodeandtheOravcleimplementationofDataFileCatalogweresubjectedtotestduringCDFCommissioningRunlastfallandduringfirstweeksofRunIIinApril.Itperformedexceptionallywell.

  • 标签: CDF实验 数据处理 数据文件目录
  • 简介:WehavedevelopedadataobjectdescriptiontoolsuiteandserviceforAthenaconsistingof:alanguagegrammarbaseduponanextendedpropersubsetofIDL2.0,acompilerfrontendbaseduponthislanguagegrammar,JavaCC,andaJavaReflectionAPI-likeinterface,andseveralcompilerbackendswhichmeetspecificneedsinATLASsuchasautomaticgenerationofobjectconvertersanddataobjectscriptinginterfaces.WepresentheredetailsofourworkandexperiencetodateontheAthenaDefinitionLanguageandAthenaDataDictionary.

  • 标签: 软件开发 ATLAS软件 Athena数据字典
  • 简介:TheD0experiment'sdataandjobmanagementsystemsoftware,SAM,isanoperationalprototypeofmanyoftheconceptsbeingdevelopedforGridcomputing.WeexplainhowthecomponentsofSAMmapintotheDataGridarchitecture,WediscussthefutureuseofGridcomponentstoeitherreplaceexistingcomponentsofSAMortoextenditsfunctionalityandutility.owrkbeingcarriedoutaspartoftheParticlePhysicsDataGrid(PPDG)project.

  • 标签: 粒子物理学 数据网格 SAM
  • 简介:Powerfulmainstreamcomputingequipmentandtheadventofaffordablemulti-Gigabitcommunicationtechnologyallowustotackledataacquisitionproblemswithclustersofinexpensivecomputers.Suchnetworkstypicallyincorporateheterogeneousplatforms,real-timepartitionsandcustomdevices.Therefore,onemuststriveforasoftwareinfrastructurethatefficientlycombinesthenodestoasingle,unifiedresourcefortheuser,Overallrequirementsforsuchmiddlewarearehighefficiencyandconfigurationflexibility.IntelligentI/O(I2O)isanindustryspecificationthatdefinesaunifrommessagingformatandexecutingmodelforprocessor-enabledcommunicationequipment.Mappingthisconcepttoadistribultedcomputingenvironmentandencapsulatingthedetailsofthespecificationintoanapplication-programmingframeworkallowustoproviderun-timesupportforclusteroperation.Thispapergivesabriefoverviewofaframework.XDAQthatwedesignedandimplementedatCERNfortheCompactMuonSolenoidexperiment'sprototypedataacquisitionsystem.

  • 标签: CMS实验 数据收集 软件