Australia: AI in the boardroom: could robots soon be running companies?

Last Updated: 23 September 2019
Article by Justin Fox, James North and Jennifer Dean

Artificial intelligence (AI) and automation more broadly continue to be identified as the next frontier in productivity enhancement and growth. Last year, McKinsey estimated AI could potentially increase economic outputs by $13 trillion by 2030, and add to global GDP by approximately 1.2%.1

Consistent with the trend, it is likely that Australian boards will increasingly look to AI and machine learning to improve the quality of their decision making. But can an algorithm run a company instead of a director?

The term 'AI' is often used synonymously with machine learning, but this is not strictly correct.

True AI exhibits features of human-like intelligence and the ability to use human-like judgement in decision-making. This is in contrast to machine learning tools that conduct statistical analysis of data sets to identify patterns, but which are not exercising 'judgement' to reach conclusions. Despite these differences, both AI and machine learning tools rely on large, high quality data sets to improve, and both will inevitably make mistakes along the way.

Predictions of robots in the boardroom are not far-fetched. In late 2016, OMX-listed Tieto Corporation announced that it had appointed an AI platform known as Alicia T to be a member of its executive leadership team. Alicia T is equipped with a conversational interface that allows its human counterparts to ask it questions. The platform even has a vote on some management decisions.

More recently, Hong Kong venture capitalist Deep Knowledge Ventures appointed an algorithm known as Vital to help the fund make its investment decisions. These appointments reflect a growing acceptance that machine learning may be capable of making better business decisions than human beings.

Can an algorithm run a company instead of a director?

For the time being, the answer to this question is no. A robot can't be a director under Australian law. By definition, a director must be a 'person'. We do expect, however, that directors will increasingly seek to use machine learning and AI to assist them in their own decision making and to rely on decisions taken elsewhere within the organisation that are the product of the application of AI. In this context, it is critical that directors are aware of the legal risks associated with using AI and how to properly manage them.

AI is not foolproof and directors must expect that some decisions made by AI will be wrong. This may be for numerous reasons, including that:

  • the algorithm is incorrect or poorly understood;
  • the data set is inappropriate or is contaminated by bias; or
  • the decision making was impacted by coding error or malfeasance (e.g. hacking).

Where the AI is wrong, this can result in wrong decisions or even decisions that breach the law. For example, in the human resources context, the use of AI tools in conjunction with data about previous successful employees to predict which candidates are most likely to be successful in the future may simply reinforce existing biases or discrimination in hiring practices. The issue for directors is whether they might be exposed to a breach of their duty to exercise reasonable care and diligence as a result of the failure of the AI.

AI and safe harbours

There are three important safe harbours available under the Corporations Act to directors who are accused of breaching their duty to exercise reasonable care and diligence. These are:

  • the business judgement rule in section 180(2);
  • the right of reliance in section 189; and
  • the right to delegate in section 190.

Australian courts have not yet had an opportunity to consider how those safe harbours might respond to a case where an impugned decision was made by or with the assistance of AI. However, a first principles assessment suggests that the safe harbours might not be available if directors were to simply adopt decisions made by AI without exercising independent judgement.

  1. The business judgement rule

Under section 180(2) of the Corporations Act, a director who makes a business judgement is taken to have discharged his or her duty of care and diligence if they:

  • make the judgement in good faith and for a proper purpose;
  • do not have a material personal interest in the subject matter of the judgement;
  • inform themselves about the subject matter of the judgement to the extent they reasonably believe to be appropriate; and
  • rationally believe that the judgement is in the best interests of the company. This will be the case unless the belief is one that no reasonable person in their position would hold.

There would seem to be two potential obstacles to a director who relies on AI to make a decision, taking advantage of the business judgement rule (assuming that items 1,2 and 4 are made out).

The first is whether the director has made a 'business judgement' at all. Under section 180(3), a business judgement means any decision to "take or not take action in respect of a matter relevant to the business operations of the corporation". In ASIC v Rich, Austin J noted that the decision must be 'consciously made' and that the director must have 'turned his or her mind to the matter'. Austin J's language seems to attach to the impugned decision itself rather than to the preceding decision to make that decision using AI. It would appear, therefore, that a director who wholly hands over decision making to AI does not make a business judgement to which the defence can attach.

This point is further underscored by the requirement in section 180(2)(c) that the director must have informed themselves about the subject matter of the judgement 'to the extent they reasonably believe to be appropriate'. Again, this requirement appears to attach to the impugned decision and is not satisfied by a director who determines that a class of decision making can be best left to AI. If any of those decisions turn out to be incorrect, the director can hardly say that they have informed themselves about the subject matter of that decision in the manner required by section 180(2)(c).

  1. The right to delegate

Section 198D(1)(d) of the Corporations Act entitles directors to delegate any of their powers to another 'person'. Again, the reference to a 'person' here precludes delegation to a machine. The directors may, however, choose to delegate to a person (such as an employee) who they know will rely on the use of AI for the purposes of discharging that power.

Under section 190(2)(b), a director is not responsible for the actions of the delegate where the director believed on reasonable grounds, in good faith and after making proper enquiry if the circumstances indicated the need for inquiry, that the delegate was reliable and competent in relation to the power delegated. Therefore, the question is what inquiry should directors undertake before they delegate any of their decision making power to a person who will use AI in exercising that power?

We would suggest that the proposed use of AI constitutes circumstances that 'indicate the need for inquiry' as to the reliability and competence of the decision maker within the meaning of section 190(2)(b).

Given that the decision will be made or informed by AI, this likely translates into an obligation on directors to satisfy themselves as to the reliability and competence of the AI itself. A director who fails to interrogate the algorithm and or data set, or to question the appropriateness of the particular platform being deployed to the duties being delegated, risks the court finding that the director has not satisfied himself or herself as to the reliability and competence of the delegate. In that case, the director will be liable for any failure of the delegate as if it were the director's own breach of duty see section 180(1).

  1. The right of reliance

In certain circumstances, a director is entitled to rely on information or advice taken from an employee, professional adviser, expert or another director.

Section 189 of the Corporations Act provides that a director's reliance on such information or advice will be deemed to be reasonable for the purposes of discharging that director's duty of care and diligence if the reliance was made in good faith and after making an independent assessment of the information or advice, having regard to the director's knowledge of the corporation and the complexity of the structure and operations of the corporation.

There is no apparent reason why a director would not be entitled to rely on information or advice that has been generated by the relevant adviser with the benefit of AI. What is not clear, however, is whether section 189 allows a director to rely directly on the output of AI itself. This turns on whether the court would be willing to regard the AI tool as a 'professional adviser or expert' within the meaning of section 189.

While it is unlikely that Parliament intended those words to include a machine, the wording does not necessarily preclude such a finding. Demonstrating that the AI is expert in relation to a particular subject, however, would require strong evidence as to the workings of the automated decision making and its application to the subject matter of the decision. The safer and more likely course is therefore for directors to rely on the advice of an employee or expert that has used AI in forming the advice.

Where a director relies on the advice of an employee which is generated with the help of AI, the director must believe on reasonable grounds that the employee is 'reliable and competent in relation to the matters concerned'. In the case of a professional adviser, the director must believe on reasonable grounds that the 'matter is within the person's professional or expert competence'. This creates a potential disconnect where machine learning is used to reach a decision, as the person who is expert in the application of AI may not be expert in the subject matter to which the AI is being deployed. The language of the Corporations Act seems to require expertise in relation to the subject matter rather than expertise in the way that decisions are made. Following the logic suggests that the reliance defence is only available where the adviser has taken the output of the AI and applied their subject matter expertise to the outcome before providing advice to the board.

The final requirement – that the director must have made an 'independent assessment' of the information or advice on which he or she relies – is perhaps the most significant.

This goes beyond the equivalent requirement in the business judgement rule (which requires that the director be informed about the subject matter of the judgement 'to the extent they reasonably believe to be appropriate') or the delegation right (which requires the director to make proper enquiry that the delegate was reliable and competent), in that it requires the director to actively interrogate the advice itself. The degree of interrogation required will vary depending on the gravity of the decision and its potential consequences to the company. On any assessment, however, it appears that a director must not simply follow a decision that is formed by AI and must form their own view on the issue, if the reliance defence is to be made out.

Looking ahead

It is clear from the above analysis that directors who wish to make use of AI should do so as an aide to their own decision making, rather than as a substitute for making an independent assessment.

On every level, the law continues to expect directors to exercise an inquiring mind as to the matters before them and to interrogate the advice and information on which they rely. The risk of automation bias, where humans are inclined to assume that a decision made by machine must be correct, is significant.

In the case of AI tools, directors will need to invest in their understanding of the technology and how it is being deployed. This can be challenging in the context of complex proprietary systems, but at the very least, directors should be requiring rigorous testing of the outputs of AI tools for inbuilt biases and other problems.

At the end of this article, we have set out a series of questions that directors may choose to ask in relation to the use of AI tools in the company in order to guard against the risks identified in this article. However, in most cases, we would recommend that a director seeks advice from their General Counsel or other legal adviser about the use of AI tools in decision making prior to their being deployed.

Proponents of AI may complain that imposing requirements on directors to 'second guess' AI defeats the purpose of the technology, and risks impeding innovation and good decision making in Australian boardrooms. We consider, however, that the current state of the law is well placed to both support the further implementation of AI tools and preserve good governance in decision making.

It is important that responsibility for corporate decisions continues to rest with a tangible being who is ultimately answerable to shareholders. This tension will support the development of good AI and the sensible application of new tools to boardroom decisions.

Further regulation of AI is also on the horizon, with a number of jurisdictions considering the ethical and liability implications of the use of these technologies.

10 key questions for directors to ask in relation to AI

  1. Where do we use AI in our business?
  2. What decisions does it make?
  3. Who could be impacted by those decisions?
  4. Do we tell people who could be impacted by the decision that we have used AI and that they have a right to have the decision reviewed by a person?
  5. Do we understand the algorithm?
  6. Is it consistent with our values/objectives?
  7. Have we satisfied ourselves that the data source is appropriate for our specific use?
  8. Do we have a human decision making process as part of our decision making loop – if not, do we undertake spot checks and trend analysis of the AI generated output?
  9. Is the decision making process transparent – can it be audited?
  10. Did we buy the tool from a third party vendor? If so, what warranties has the vendor given us as to performance?

Footnote

1 McKinsey & Company, Notes from the AI frontier: Modelling the impact of AI on the world economy (April 2018)

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

Chambers Asia Pacific Awards 2016 Winner – Australia
Client Service Award
Employer of Choice for Gender Equality (WGEA)

To print this article, all you need is to be registered on Mondaq.com.

Click to Login as an existing user or Register so you can print this article.

Authors
 
Some comments from our readers…
“The articles are extremely timely and highly applicable”
“I often find critical information not available elsewhere”
“As in-house counsel, Mondaq’s service is of great value”

Related Topics
 
Related Articles
 
Related Video
Up-coming Events Search
Tools
Print
Font Size:
Translation
Channels
Mondaq on Twitter
 
Mondaq Free Registration
Gain access to Mondaq global archive of over 375,000 articles covering 200 countries with a personalised News Alert and automatic login on this device.
Mondaq News Alert (some suggested topics and region)
Select Topics
Registration (please scroll down to set your data preferences)

Mondaq Ltd requires you to register and provide information that personally identifies you, including your content preferences, for three primary purposes (full details of Mondaq’s use of your personal data can be found in our Privacy and Cookies Notice):

  • To allow you to personalize the Mondaq websites you are visiting to show content ("Content") relevant to your interests.
  • To enable features such as password reminder, news alerts, email a colleague, and linking from Mondaq (and its affiliate sites) to your website.
  • To produce demographic feedback for our content providers ("Contributors") who contribute Content for free for your use.

Mondaq hopes that our registered users will support us in maintaining our free to view business model by consenting to our use of your personal data as described below.

Mondaq has a "free to view" business model. Our services are paid for by Contributors in exchange for Mondaq providing them with access to information about who accesses their content. Once personal data is transferred to our Contributors they become a data controller of this personal data. They use it to measure the response that their articles are receiving, as a form of market research. They may also use it to provide Mondaq users with information about their products and services.

Details of each Contributor to which your personal data will be transferred is clearly stated within the Content that you access. For full details of how this Contributor will use your personal data, you should review the Contributor’s own Privacy Notice.

Please indicate your preference below:

Yes, I am happy to support Mondaq in maintaining its free to view business model by agreeing to allow Mondaq to share my personal data with Contributors whose Content I access
No, I do not want Mondaq to share my personal data with Contributors

Also please let us know whether you are happy to receive communications promoting products and services offered by Mondaq:

Yes, I am happy to received promotional communications from Mondaq
No, please do not send me promotional communications from Mondaq
Terms & Conditions

Mondaq.com (the Website) is owned and managed by Mondaq Ltd (Mondaq). Mondaq grants you a non-exclusive, revocable licence to access the Website and associated services, such as the Mondaq News Alerts (Services), subject to and in consideration of your compliance with the following terms and conditions of use (Terms). Your use of the Website and/or Services constitutes your agreement to the Terms. Mondaq may terminate your use of the Website and Services if you are in breach of these Terms or if Mondaq decides to terminate the licence granted hereunder for any reason whatsoever.

Use of www.mondaq.com

To Use Mondaq.com you must be: eighteen (18) years old or over; legally capable of entering into binding contracts; and not in any way prohibited by the applicable law to enter into these Terms in the jurisdiction which you are currently located.

You may use the Website as an unregistered user, however, you are required to register as a user if you wish to read the full text of the Content or to receive the Services.

You may not modify, publish, transmit, transfer or sell, reproduce, create derivative works from, distribute, perform, link, display, or in any way exploit any of the Content, in whole or in part, except as expressly permitted in these Terms or with the prior written consent of Mondaq. You may not use electronic or other means to extract details or information from the Content. Nor shall you extract information about users or Contributors in order to offer them any services or products.

In your use of the Website and/or Services you shall: comply with all applicable laws, regulations, directives and legislations which apply to your Use of the Website and/or Services in whatever country you are physically located including without limitation any and all consumer law, export control laws and regulations; provide to us true, correct and accurate information and promptly inform us in the event that any information that you have provided to us changes or becomes inaccurate; notify Mondaq immediately of any circumstances where you have reason to believe that any Intellectual Property Rights or any other rights of any third party may have been infringed; co-operate with reasonable security or other checks or requests for information made by Mondaq from time to time; and at all times be fully liable for the breach of any of these Terms by a third party using your login details to access the Website and/or Services

however, you shall not: do anything likely to impair, interfere with or damage or cause harm or distress to any persons, or the network; do anything that will infringe any Intellectual Property Rights or other rights of Mondaq or any third party; or use the Website, Services and/or Content otherwise than in accordance with these Terms; use any trade marks or service marks of Mondaq or the Contributors, or do anything which may be seen to take unfair advantage of the reputation and goodwill of Mondaq or the Contributors, or the Website, Services and/or Content.

Mondaq reserves the right, in its sole discretion, to take any action that it deems necessary and appropriate in the event it considers that there is a breach or threatened breach of the Terms.

Mondaq’s Rights and Obligations

Unless otherwise expressly set out to the contrary, nothing in these Terms shall serve to transfer from Mondaq to you, any Intellectual Property Rights owned by and/or licensed to Mondaq and all rights, title and interest in and to such Intellectual Property Rights will remain exclusively with Mondaq and/or its licensors.

Mondaq shall use its reasonable endeavours to make the Website and Services available to you at all times, but we cannot guarantee an uninterrupted and fault free service.

Mondaq reserves the right to make changes to the services and/or the Website or part thereof, from time to time, and we may add, remove, modify and/or vary any elements of features and functionalities of the Website or the services.

Mondaq also reserves the right from time to time to monitor your Use of the Website and/or services.

Disclaimer

The Content is general information only. It is not intended to constitute legal advice or seek to be the complete and comprehensive statement of the law, nor is it intended to address your specific requirements or provide advice on which reliance should be placed. Mondaq and/or its Contributors and other suppliers make no representations about the suitability of the information contained in the Content for any purpose. All Content provided "as is" without warranty of any kind. Mondaq and/or its Contributors and other suppliers hereby exclude and disclaim all representations, warranties or guarantees with regard to the Content, including all implied warranties and conditions of merchantability, fitness for a particular purpose, title and non-infringement. To the maximum extent permitted by law, Mondaq expressly excludes all representations, warranties, obligations, and liabilities arising out of or in connection with all Content. In no event shall Mondaq and/or its respective suppliers be liable for any special, indirect or consequential damages or any damages whatsoever resulting from loss of use, data or profits, whether in an action of contract, negligence or other tortious action, arising out of or in connection with the use of the Content or performance of Mondaq’s Services.

General

Mondaq may alter or amend these Terms by amending them on the Website. By continuing to Use the Services and/or the Website after such amendment, you will be deemed to have accepted any amendment to these Terms.

These Terms shall be governed by and construed in accordance with the laws of England and Wales and you irrevocably submit to the exclusive jurisdiction of the courts of England and Wales to settle any dispute which may arise out of or in connection with these Terms. If you live outside the United Kingdom, English law shall apply only to the extent that English law shall not deprive you of any legal protection accorded in accordance with the law of the place where you are habitually resident ("Local Law"). In the event English law deprives you of any legal protection which is accorded to you under Local Law, then these terms shall be governed by Local Law and any dispute or claim arising out of or in connection with these Terms shall be subject to the non-exclusive jurisdiction of the courts where you are habitually resident.

You may print and keep a copy of these Terms, which form the entire agreement between you and Mondaq and supersede any other communications or advertising in respect of the Service and/or the Website.

No delay in exercising or non-exercise by you and/or Mondaq of any of its rights under or in connection with these Terms shall operate as a waiver or release of each of your or Mondaq’s right. Rather, any such waiver or release must be specifically granted in writing signed by the party granting it.

If any part of these Terms is held unenforceable, that part shall be enforced to the maximum extent permissible so as to give effect to the intent of the parties, and the Terms shall continue in full force and effect.

Mondaq shall not incur any liability to you on account of any loss or damage resulting from any delay or failure to perform all or any part of these Terms if such delay or failure is caused, in whole or in part, by events, occurrences, or causes beyond the control of Mondaq. Such events, occurrences or causes will include, without limitation, acts of God, strikes, lockouts, server and network failure, riots, acts of war, earthquakes, fire and explosions.

By clicking Register you state you have read and agree to our Terms and Conditions