Prohibits state agencies and state-owned entities from utilizing large language models or any artificial intelligence systems to make decisions that affect individuals' rights, benefits, or services; requires such decisions to be made by human personnel of the respective state agency or state-owned entity; provides exceptions; provides for enforcement.
STATE OF NEW YORK
________________________________________________________________________
10583
IN ASSEMBLY
June 20, 2024
___________
Introduced by COMMITTEE ON RULES -- (at request of M. of A.
Bichotte Hermelyn) -- read once and referred to the Committee on
Science and Technology
AN ACT to amend the state technology law, in relation to prohibiting the
use of certain artificial intelligence models
The People of the State of New York, represented in Senate and Assem-bly, do enact as follows:
1 Section 1. The state technology law is amended by adding a new section
2 106-c to read as follows:
3 § 106-c. Use of artificial intelligence programs. 1. As used in this
4 section:
5 a. "artificial intelligence" or "AI" means any machine-based system
6 that makes decisions based on algorithms, machine learning, or any form
7 of data-driven modeling;
8 b. "large language model" or "LLM" means any AI model designed to
9 understand and generate human language based on large datasets;
10 c. "state agency" means any department, board, bureau, division,
11 commission, committee, public benefit corporation, public authority, or
12 other governmental entity of the state; and
13 d. "state-owned entity" means any entity that is owned or controlled
14 by the state, including but not limited to public universities, state-
15 run hospitals, and other state-funded organizations.
16 2. No state agency or state-owned entity shall implement or utilize
17 large language models or any artificial intelligence systems to make
18 decisions that affect individuals' rights, benefits, or services. All
19 decisions affecting individuals' rights, benefits, or services must be
20 made by human personnel of the respective state agency or state-owned
21 entity.
22 3. a. The provisions of this section shall not apply to the use of AI
23 or LLMs in purely advisory capacities, provided that the final decision
24 is made by human personnel.
25 b. The use of AI for data analysis, research, or other non-decision-
26 making purposes is not prohibited by this section.
EXPLANATION--Matter in italics (underscored) is new; matter in brackets
[] is old law to be omitted.
LBD15794-01-4
A. 10583 2
1 4. Each state agency and state-owned entity shall develop and imple-
2 ment policies and procedures to ensure compliance with this section.
3 5. The attorney general shall have the authority to investigate
4 violations of this section and take appropriate legal action to enforce
5 its provisions.
6 § 2. This act shall take effect on the ninetieth day after it shall
7 have become a law.
