Report of TWG AI: Landscape of AI Standards

AI Index Report, 2023

For anyone following what is happening in AI technology, this is the sixth edition of the AI Index Report. Please consider voicing your opinion about any of the contents here. This year, 2023, the report introduces more original data than any previous edition, including a new chapter on AI public opinion, a more thorough technical performance chapter, original analysis about large language and multimodal models, detailed trends in global AI legislation records, a study of the environmental impact of AI systems, and more. The AI Index Report tracks, collates, distills, and visualizes data related to artificial intelligence. Our mission is to provide unbiased, rigorously vetted, broadly sourced data in order for policymakers, researchers, executives, journalists, and the general public to develop a more thorough and nuanced understanding of the complex field of AI. The report aims to be the world's most credible and authoritative source for data and insights about AI.

arXiv (Cornell University), 2023

Welcome to the sixth edition of the AI Index Report! This year, the report introduces more original data than any previous edition, including a new chapter on AI public opinion, a more thorough technical performance chapter, original analysis about large language and multimodal models, detailed trends in global AI legislation records, a study of the environmental impact of AI systems, and more. The AI Index Report tracks, collates, distills, and visualizes data related to artificial intelligence. Our mission is to provide unbiased, rigorously vetted, broadly sourced data in order for policymakers, researchers, executives, journalists, and the general public to develop a more thorough and nuanced understanding of the complex field of AI. The report aims to be the world's most credible and authoritative source for data and insights about AI.

2020

Standard is document that establishes the requirements, specifications, guidelines or characteristics according to which materials, products, processes and services that are suitable for these purposes can be used. ISO has more than 21,000 international standards covering aspects of technology and business. Standardization of artificial intelligence is advisable to start with concepts. The standard of artificial intelligence can be defined as follows. Artificial intelligence is a scientific applied direction for the development and creation of technological and software cognitive complexes of the digital twin of human intelligence, capable of learning, retraining, self-realization and development on the basis of the criterion of preferences and to improve functional activities by quality choice and mastering creative innovative high-tech artificial intelligence, a roadmap is being developed. The main tasks of standardization of artificial intelligence are, firstly, the unification and standardization of terminology, ensuring the interoperability of artificial intelligence systems, ensuring methodological continuity in the field of artificial intelligence methods and algorithms, and improving the effectiveness of collective work on creating artificial intelligence systems. Secondly, the removal of regulatory barriers related to the processing of personal data. Thirdly, standardization of procedures for confirming the predictability of the behavior of the artificial intelligence system under certain operating conditions, standardization of procedures for confirming the safety of the functioning of the artificial intelligence system. Fourth, unification of quality characteristics of artificial intelligence systems aimed at solving specific application problems. Fifth, standardization of requirements for technology platforms with artificial intelligence, development of standard artificial intelligence cases for the development and use of intelligent systems and technologies. Artificial intelligence technologies are already ripe enough to standardize them. Without it, the industry will not be able to develop normally, the interests of the state and society will not be protected. The United States, China, other countries and international organizations have begun active work in this direction. Standardization of artificial intelligence will help to find boundaries in which artificial intelligence will benefit humanity and not harm.

The AI Index 2019 Annual Report, 2019

The AI Index was conceived within the One Hundred Year Study on AI (AI100).Research and Development Conferences. Published by Stanford Human Centered AI. The AI Index Report tracks, collates, distills, and visualizes data relating to artificial intelligence. Its mission is to provide unbiased, rigorously-vetted data for policymakers, researchers, executives, journalists, and the general public to develop intuitions about the complex field of AI. Expanding annually, the Report endeavors to include data on AI development from communities around the globe. It includes sections on Technical Performance, The Economy, Education, Autonomous Systems Public Perception, Societal Considerations, National Strategies and Global AI Vibrancy.

Machine Learning and Knowledge Extraction

The main challenges are discussed together with the lessons learned from past and ongoing research along the development cycle of machine learning systems. This will be done by taking into account intrinsic conditions of nowadays deep learning models, data and software quality issues and human-centered artificial intelligence (AI) postulates, including confidentiality and ethical aspects. The analysis outlines a fundamental theory-practice gap which superimposes the challenges of AI system engineering at the level of data quality assurance, model building, software engineering and deployment. The aim of this paper is to pinpoint research topics to explore approaches to address these challenges.

2022

We have developed capAI, a conformity assessment procedure for AI systems, to provide an independent, comparable, quantifiable, and accountable assessment of AI systems that conforms with the proposed AIA regulation. By building on the AIA, capAI provides organisations with practical guidance on how high-level ethics principles can be translated into verifiable criteria that help shape the design, development, deployment and use of ethical AI. The main purpose of capAI is to serve as a governance tool that ensures and demonstrates that the development and operation of an AI system are trustworthy – i.e., legally compliant, ethically sound, and technically robust – and thus conform to the AIA.

of connectionist neural networks, while others use mathematical models of decision processes or view intelligence as symbol manipulation. Similarly, researchers focus on different processes for generating intelligence, such as learning through reinforcement, natural evolution, logical inference, and statistics. The result is a panoply of approaches and subfi elds.

2021

This paper reviews developments in Artificial Intelligence over the last 70 years. As such we begin with gestation of AI, and proceed to discuss early development, recent developments and future trends in AI. In doing so we point out background for emergence of the field of AI, gestation of AI with a particular emphasis on symbolic AI, which lead to knowledge modelling in the context of cognitive systems as a pragmatic approach to build intelligence programs such as expert systems, natural language processing, game playing, problem solvers and theorem provers. Background and implications of emergence of machine learning since early 2000 has also been discussed. The paper also highlights major AI programs including DART, Deep Blue, Pathfinder, Google self-driving car, AlphaGo and Watson, which made AI so attractive not only to researchers but also to general public. Finally, future trends of AI including manmachine coexistence, cyborgs, hybrid intelligence, mind uploading, and biolog...

Last year (2016) the White House travelled across the US talking to AI researchers on the future, concerns and technical challenges we face. Here is their report that brings it all together. Note this is from the Obama administration.