Natural language processing trials

In February 2018, ASIC released a set of problem statements with use cases to understand and encourage the application of natural language processing (NLP) in resolving regulatory problems. The trials were to explore potential efficiencies in supervision, including through automation and prediction, and provided a genuine learning opportunity for ASIC. ASIC’s tender was issued for the provision of pilots in:

  • Identifying promotions of concern for financial and credit services
  • Phone sales practices of insurance
  • Managed-fund Product Disclosure Statements (PDS) review
  • Financial advice file review
  • Financial reporting review of company announcements
  • Prospectus review.

ASIC’s 2018 NLP trial results

Data availability

NLP does not transform poor-quality data into high-quality data, and it cannot find data where none exists. Therefore, a challenge in ASIC’s NLP trials has been sourcing the right kind of data – and in sufficient quantity. Poor quality or inadequate data produces models that do not produce useful outputs or that are very limited in scope.

Data annotation

For machine-learning processes ASIC needed to ‘teach’ the machine what it needed to find. This included annotating PDS’s to highlight relevant features, which was time consuming, as was the time required to identify problematic examples.

This led to a second issue – a lack of sufficient quantity. ASIC needed a large volume of misleading or deceptive examples to teach the machine what to look for. These example are rare.

Next steps: enhancing our knowledge base, personnel and capacity

Like many organisations, ASIC is considering the skills and resources it needs to integrate regtech into its everyday operations. The NLP trials provided practical insight on that front.

ASIC is conducting further NLP-related trials in 2019. See the events section for more information.

Innovation Hub Logo Bw

Subscribe for updates

IhsubscribeSubscribe to receive news alerts on a wide range of Innovation Hub activities including news, events, publications, announcements, and more.

Subscribe now

News

Ihnews

Financial Advice Promotions Symposium

2 August 2019

This inaugural Regtech Initiatives event successfully wrapped up. It displayed how regtech can help improve compliance and quality of financial promotions and advertising, both printed and online.

Click here to watch the livestream

Find out more

Fintech innovations podcasts

31 July 2019

This podcast series from Toronto Centre gives regulatory and market perspectives on fintech innovations currently taking place in Australia.

Introducing the newest technology to capital markets - Oliver Harvey, ASIC and Katie McDermott, ASX provide regulator and industry perspectives.

To protect or to foster innovation: An inside look at a regulator's initiative to do both -  Mark Adams, ASIC

Listen to the podcasts


Archive

Events

Ihnews

Voice Analytics & Voice-to-Text Trial and Symposium

Join ASIC on Tuesday 24 September 2019 to learn the results of its Voice Analytics & Voice-to-Text (VA&VT) trial.

Find out more


Archive

Last updated: 01/05/2019 04:56