Committed to connecting the world

SDG

FG-AI4H Working Group ToRs

Automatic Translation: English عربي 中文 Español Français Русский

 ​​Jump to:

WG-DAISAM   > WG-DASH   > WG-Ethics   > WG-O   ​> WG-RC​​

WG-DAISAM: Data and AI solution assessment methods

Ch​air:

Pat Baird (Philips)

​Vice-​​chair:

Luis Oala (Fraunhofer HHI, DE)

Collaboration Site​
​​

ToR 

Scope

This WG is concerned with the identification and definition of methods for data and AI solution assessment, while the implementation of said methods is coordinated with the WG Data and AI Solution Handling.

The modus operandi for this WG is in close cooperation with the TGs, in particular for the definition of task specific assessment methods for data and the AI solutions, as well as the other WGs that work on the technical implementation of the standardized assessment framework.

Specific issues to be addressed include

The WG pursues the following tasks:

a) Identify r​​elevant categories of AI solution assessment; e.g. performance, stability, or transparency among others; in close cooperation with the topic drivers from the TGs.

b) Specify concrete methods for AI solution assessment based on (1) task specific considerations and (2) state-of-the art machine learning research. This collection of methods shall include comments on benefits and limits of the included methods.

c) Identify relevant categories of data assessment; e.g. balance, representation or measurement quality among others; in close cooperation with the topic drivers from the TGs.

d) Specify concrete methods for data assessment based on (1) task specific considerations and (2) state-of-the art machine learning research. This collection of methods shall include comments on benefits and limits of the included methods.

Deliv​erabl​es

a) Recommendations for categories of data and AI solution assessment ​

b) Recommendations for data and AI solution assessment methods with comments on benefits and limits of the included methods 

c) Implementation specifications of B. to WG Data and AI Solution Handling​

d) Progress reports to FG 

Relationships

WG-DASH: Data and AI solution ​handling

Chair:

Marc Lecoultre (MLlab.AI, CH)

Vice ​chair:

Ferath Kerif (CHUV, CH)​​​​

Collaboration Site​
​​​

ToR ​​

Scope

This Working Group focuses on the operational aspects of data processing throughout the data lifecycle. The term data refers to the submitted (public, private, and example) datasets, as well as the AI solutions (algorithms/models) submitted for the benchmarking process. It works on the definition of best practices, establishes processes and related policies, and creates reference documents. WG-DASH deals with the "how" the Focus Group on AI4H should perform its operations when the data are used.
NOTE - It differs from the Working Group on Data and AI Solution Assessment Methods (WG-DAISAM) in that it focuses on the operational aspects, rather than on the tools.

Data set workflow

This group will work on all operational aspects of data workflows such as dataset submission, algorithm benchmarking or others to come.

These workflows are composed of steps or tasks that must be standardized and documented. This working group will discuss each of these steps with the appropriate experts and publish documents.

In addition to the data workflow steps, we include the life cycle of data in the context of FG-AI4H:

Some topics are transversal in the sense that they are involved in multiple workflows or steps. They must be approached in a general way and specialized in the context of their use.

Transversal topics

Deliverables

The working group is to deliver

Relationships

WG-Ethics: Ethical considerations on AI for health

Chair

Andreas Reis (WHO)

Collaboration Site​

​Motiv​​ation

Digital technologies, machine learning and Artificial Intelligence (AI) are revolutionizing the fields ​of medicine, research and public health in an unprecedented manner. While holding great promise, this rapidly developing field raises a number of ethical, legal, and social concerns. There is an urgent need to develop harmonised ethics guidance for the design and implementation of AI in global health. Moreover, to secure AI benefits at the global scale, a new collaborative research agenda should be established. WG-Ethics will address these ethical concerns and provide guidance to the users of AI.

Sc​​ope

Producing harmonised ethics guidance for the design and implementation of AI in global health; addressing the ethical development and use of these technologies, including how low- and middle-income countries will benefit from AI developments.

Specific questio​​ns to be addressed include:

Deliverab​​les

Relation​​​ships

WG-O: Operations

Co-chairs

Markus Wenzel and Monique Kuglitsch 
(Fraunhofer HHI, Germany)

Collaboration Site​

ToR

Motivation

The focus group tackles a challenging and complex problem by joining artificial intelligence and health - and thus two fields that had been disparate until recently. Several aspects of a wide spectrum of topics have to be addressed and brought together consistently. Therefore, the group is organized along a matrix of work groups and topic areas, where topic drivers cooperate with the working group chairs. Within a tight timeframe of two years, workshops and meetings will be held at a fast pace around the globe. Against this background, it is of paramount importance that all ongoing processes are operated efficiently, effectively, timely and in a coherent way.

Scope

The working group “operations" addresses operational tasks such as logistics, meetings, agendas, reports, and other aspects that are required for the internal procedures of the Focus Group.

Specific questions to be addressed include:

Tasks include, but are not limited to:

Deliverables

Relationships



WG-RC: Regulatory considerations on AI for health

Cha​​ir

Naomi Lee (Lancet, UK)

Vice-c​​h​​​airs:

Collaboration Site​

Structure

The diagram below illustrates the proposed structure of the Working Group "Regulatory considerations on AI for health" (WG-RC).fgai4h-wg-rc-struct.png

The WG has o​ne chair nominated by the Focus Group. ITU or WHO members can each nominate a vice-chair from their regulatory bodies*. ​Vice-chair nominations are confirmed either at Focus Group meetings or by the FG management in-between meetings.​

* Regulatory bodies are meant here to include national and regional organizations that have in their mandate the responsibility for assessing the safety and efficacy of AI for health technologies within their jurisdictions.

Scope and des​​​cription

The working group "Regulatory considerations for AI" will help guide the FG in navigating the regulatory landscape; facilitating contacts, information exchange, and collaborative opportunities of the FG with regulatory bodies. The working group will help outline key regulatory considerations that are relevant to regulatory agencies for AI development. The working group will also help define ways to successfully benchmark AI for health algorithms.

​Specific issues to be addressed include:

​Deliverabl​e​​s and timeframe

The working group is to deliver the following:

Representations and​ interactions