No AI tool that makes logging optional should be expected to operate safely.

If “safety” is something you have to turn on, any tool will be used unsafely. Today, unsafe yet powerful AI tools are made available for anyone, for free – tensorflow, openAI, et al.

Even America has some regulations on handing out free guns, but powerful features are added for commercial reasons, and turned loose for the public. It is sheer folly that free tools will be used with the same level of responsibility by individuals, as by organisations that claim effective checks and balances. The organisations use the same tools internally as they release for others – in a dash for market share and mindshare of developers.

The release of powerful AI tools without a correspondingly available audit or safety infrastructure suggests the claims to prioritise safety are entirely hollow – by definition, AI safety mechanisms are entirely optional, with the burden on every user and not the system.

External logging infrastructures are basically a spreadsheet. Google Docs’ spreadsheet capabilities are the minimal viable necessary for everyone (with a google account), for free. Google gives 15Gb of storage space with every account, which should be good for years of run logs, and even then, google spreadsheets don’t count in that space. The spreadsheet API lets you do this already – and you can implement a blockchain in a spreadsheet to have some level of audit.

If you don’t want to use google tools tensorflow/cloud platform/gDrive, there is also AWS. Amazon will rent you high powered GPUs for cents per hour, and have APIs for everything, include write only logging to S3, but no support for ensuring the minimal audit on your AIs you run there.

For the rugged individualists replicating AlphaGo in your back bedroom, and who don’t want to hand their logs to a megacorp, those tools could allow logging to other infrastructures (Plasma would let you confirm you are logging without saying what; many other storage options exist today).

The current version of the test is: No AI tool that makes logging optional can be expected to operate safely.

The logs can be kept private, and they can be at high level, but they have to be written. What should go in them is something the well funded AI debates continue to have, but as it stands today, the commitment to AI safety is impossible to deliver, because the tools do not require anything be logged. Nothing stops a decision to delete any logs, but deleting logs is a coverup.

This won’t do everything, but currently there’s nothing at all. And nothing at all makes the claims of AI safety sound distinctly hollow.

posted: 16 Aug 2017

UN and email alerts

Julian does an outstanding job (mostly alone) on UNDemocracy.com parsing all the PDFs they hide away, and making it all googletastic.

One of the big lessons from TheyWorkForYou.com was to push stuff out to people – RSS for the more geeky types and for reuse, and email alerts for everyone else who are the vast majority of people.

While it’s not yet visible on the undemocracy.com site (which will be when Julian gets back from caving), we now include rss feeds of whatever new material appearing in UNDemocracy.com matches your search query http://www.undemocracy.com/rss.pl?search=America.

While RSS is hip and cool in the tech community, most people have never heard of it, and just want something to land in their mailbox. It’s an easy lesson to learn that putting stuff on the website is not enough, you have to push it out to people who are interested. If what you want is the perception of transparency, without the hassle and work that comes from actually being transparent; then the UN is a prime example. While it puts the documents online (in multiple languages), it hides them quite well – no outreach – you can’t find them in google, let alone RSS or email alerts. If you want to pretend to do transparency, just put stuff on the web where no one will find it. If you want to really do transparency, create a mailing list, so those who are interested get minutes in their mailbox – they just appear somewhere that people are checking anyway. Putting them on a website is a good way of making sure that only people who really care go looking for them.

I’ll include the new material in the email alerts we send from TheUNsays.com (and will work out with Julian how to do signups for email alerts from the UND site when he’s back).

posted: 29 Jul 2008