WorldDigitalTechnologyAcademy(WDTA) GenerativeAIApplicationSecurityTesting andValidationStandard WorldDigitalTechnologyAcademyStandard WDTAAI-STR-01 Edition:2024-04©WDTA2024–Allrightsreserved. TheWorldDigitalTechnologyStandardWDTAAI-STR-01isdesignatedasaWDTA norm.ThisdocumentisthepropertyoftheWorldDigitalTechnologyAcademy(WDTA)andis protectedbyinternationalcopyrightlaws.Anyuseofthisdocument,includingreproduction, modification,distribution,orrepublication,withoutthepriorwrittenpermissionofWDTA,is prohibited.WDTAisnotliableforanyerrorsoromissionsinthisdocument. DiscovermoreWDTAstandardandrelatedpublicationsathttps://wdtacademy.org/. VersionHistory* StandardID Version Date Changes WDTAAI-STR-01 1.0 2024-04 InitialReleaseForeword WorldDigitalTechnologyAcademy(WDTA)isdedicatedtobecomingatrailblazeringlobaldigital techinnovation,alignedwiththeUnitedNationsframeworkasanNGO.Upholdingits3Sprinciple— Speed,Safety,Sharing—WDTAstrivestoacceleratethecreationofdigitalnorms,spearheadresearch, encourageinternationalcooperation,andmaintainleadershipintechnologicaladvancement. Throughcollaborativeefforts,WDTAisdedicatedtoadvancingdigitaltechnologyforthebetterment ofsociety.TheAISTR(Safety,Trust,Responsibility)program,acorepartofWDTA’sinternational initiatives,addressesthecomplexchallengesbroughtaboutbytheproliferationofAIsystems. RecognizingtherapidexpansionandintegrationofAItechnologiesworldwide,AISTRstandsatthe forefrontofglobaltechnologicalprogression. ThisstandarddocumentprovidesaframeworkfortestingandvalidatingthesecurityofGenerativeAI applications.TheframeworkcoverskeyareasacrosstheAIapplicationlifecycle,includingBase ModelSelection,EmbeddingandVectorDatabaseintheRetrieveAugmentGenerationdesign patterns,PromptExecution/Inference,AgenticBehaviors,Fine-Tuning,ResponseHandling,andAI ApplicationRuntimeSecurity.TheprimaryobjectiveistoensureAIapplicationsbehavesecurelyand accordingtotheirintendeddesignthroughouttheirlifecycle.Byprovidingasetoftestingand validationstandardsandguidelinesforeachlayeroftheAIApplicationStack,focusingonsecurity andcompliance,thisdocumentaimstoassistdevelopersandorganizationsinenhancingthesecurity andreliabilityoftheirAIapplicationsbuiltusingLLMs,mitigatingpotentialsecurityrisks,improving overallquality,andpromotingresponsibledevelopmentanddeploymentofAItechnologies. AISTRprogramrepresentsaparadigmshiftinhowweapproachthedevelopmentanddeploymentof AItechnologies.Championingsafety,trust,andresponsibilityinAIsystems,laysthegroundworkfor amoreethical,secure,andequitabledigitalfuture,whereAItechnologiesserveasenablersof progressratherthanassourcesofuncertaintyandharm.GenerativeAIApplicationSecurityTesting andValidationStandardisoneoftheAISTRstandards. FoundingChairmanofWDTA ExecutiveChairmanofWDTA