EveryWorld 2020 will bring together our three “normal” events (CreateWorld, /dev/world, X World) into a COVID-19-compatible online event.
Married this weirdo today. Good times.
This post serves as a collection of follow-up resources for my AppBuilders 2020 talk, Practical Machine Learning for iOS. If you have any questions, feel free to reach out to me (via Twitter is preferred).
If you want a full transcript, the script for this talk is available here as a PDF.
Here’s some useful links, roughly in the order they might interest you related to the talk:
- CreateML — Apple’s easy to use tool for creating machine learning models based on tasks
- CoreML — Apple’s framework for using machine learning models that are in the CoreML mlmodel format
Building a Sound Classifier:
- ECS-50 Sound Dataset
- Apple’s MLSoundClassifier — the system we’re training with CreateML to make a sound classifier
- The CoreML Survival Guide — a book that deep dives into the internals of CoreML
- Apple’s SNAudioFileAnalyzer
Building a Caption Generator:
- Apple’s model page — a great resource for getting pre-trained CoreML models
- Apple’s Vision framework
Some additional links that might be of interest:
- Apple’s Machine Learning Journal
- Data is Plural newsletter — a great newsletter the showcases all sorts of interesting datasets that can be useful for machine learning tasks
- Turi Create, Apple’s Python framework (that’s very similar to CreateML)
- Apple’s CoreML Tools — Python tools for converting models from other formats to CoreML’s format
- Fritz AI — A cool startup doing amazing things with mobile AI
- and their amazing blog (well worth it)
And finally, we have a GitHub repository with the code that was shown in the talk, as well as the code repository for our book, Practical AI with Swift, that has a whole lot of great activities for you to use (even if you don’t have the book) across sound, vision, text, and more.
We’ve just finished speaking at the O’Reilly Software Architecture Conference 2020 in New York City. It was, as always, a fabulous event, and we had a great time! In a few weeks we’ll be speaking at O’Reilly’s Strata conference in San Jose, as well!
At Software Architecture in NYC we spoke about entity component systems, in a talk entitled “Entity component systems and you: they’re not just for game developers“.
Below are some of our favourite links relating to ECS. We hope you find them useful!
- Catherine West’s RustConf closing keynote on Rust for Game development
- Entity Systems are the future of MMOG development by Adam Martin
- ECS and DoD slides by Aras Pranckevičius (Unity)
- Data Oriented Design and C++ CPPCon talk by Mike Acton
- Machine Architecture: Things Your Programming Language Never Told You talk by Herb Sutter
- What Every Programmer Should Know About Memory paper by Urlich Drepper
- The amazing talk on Blizzard’s implementation of ECS in their popular game, Overwatch, from GDC 2017
- ECS Back and Forth Part 1, Part 2 (plus Part 2 insights), Part 3, Part 4 (plus Part 4 insights), Part 5, Part 6, Part 7, and the slides from an ECS talk at the Italian C++ conference 2019
You can also find a slightly earlier version of the talk (from last year’s conference) on YouTube:
Software Architecture NYC was fabulous, and we can’t wait for the next one! We really enjoyed seeing our friend r0ml give an amazing talk (as usual), and signing copies of our Unity Game Development Cookbook!
Catch us next at the O’Reilly Strata Conference in San Jose!
The popular open source narrative game development framework, Yarn Spinner, which is maintained by Secret Lab and a fabulous community, has reached version 1.0. As part of our 1.0 release, we’ve debuted 5 exciting new features:
- Compiled Scripts — Yarn Spinner now compiles to a binary format.
- Automatic Compiling — In Unity, your Yarn scripts will automatically be compiled when they change.
- Line Tagging — You can automatically add unique tags to lines of dialogue, and generate a .csv file to send to translators with the click of a button.
- Code Extension — There’s a syntax highlighting extension, available from the marketplace, for Visual Studio Code.
- No more .yarn.txt — The file extension is now .yarn! It was time.
We want Yarn Spinner to be the best tool that it can be. As part of that, we’ve launched a Patreon page, and we’d love for you to help support its development!
We’ve got big plans, so please check out the website, follow us on Twitter, support the Patreon if you can, and join our Narrative Game Development Slack. And we’d really appreciate it if you shared the news!
🤩 New book!
Our new book, which I wrote with my partner, Mars, and my great friends Tim, and Jon, is out! It covers everything you need to make amazing AI- and ML-powered features in Swift apps! It’s really good, and we’re really proud, and reviews really help. Check it out on Amazon or on O’Reilly’s Learning Platform.
Get your /dev/world/2019 tickets soon! Don’t miss out!/dev/world/2019 is fast approaching, and discounted Early Bird tickets are available until 9 August 2019.
A ticket gets you access to three days of workshops, sessions, and networking — it’s a great deal! /dev/world/2019 runs in Melbourne at RMIT, and features speakers from companies like Google, Canva, Mercari, Etsy, CBA and beyond, covering topics from the latest SwiftUI, to Flutter, to Rich Notifications, to hand puppets with Augmented Reality (AR).
Join us at /dev/world! For more information and tickets, visit https://devworld.com.com.au
The first announced Featured Presentation at /dev/world/2019 will be from Simon Joslin and Matthew Clark, from The Voxel Agents, developers of The Gardens Between, the Apple Design Award-winning adventure puzzle game. They’ll be talking about good design, and how it can’t just be rushed.
Get your tickets at https://devworld.com.au ❤️
Submit your Swift, iOS, macOS, or related talks to the best tiny conference in the world! Join us for the 12th /dev/world! The Call for Presenters is now open at https://devworld.com.au/
This week at the Strata Data Conference, in London, Mars and I gave a talk on Science Fictional User Interfaces. It was a very enjoyable talk to prepare, and we were really thrilled to be given a slot at such a technical data-focused conference as Strata, to effectively rant about how great science-fiction is, and how everyone should watch, read, and play more sci-fi.
This post serves to provide some links to resources that we mentioned in the presentation, or that we think you’d find useful if you enjoyed the presentation. We’ll also post a video of the talk here, once it is available (usually a few weeks!)
If you’re interested in reading more about this topic, there’s two amazing books that cover similar ground:
- Science Fiction Prototyping (Brian David Johnson) — available from O’Reilly’s Learning Platform and Amazon
- Make It So (Christopher Noessel and Nathan Shedroff — available from O‘Reilly’s Learning Platform, Rosenfeld Media, and Amazon
There’s also a range of books that take a different angle on a similar topic:
- Designing Agentive Technology (Christopher Noessel) — available from O’Reilly’s Learning Platform, Rosenfeld Media, and Amazon
- Speculative Everything (Anthony Dunne and Fiona Raby) — available from The MIT Press and Amazon
- Typeset in the Future: Typography and Design in Science Fiction Movies (Dave Addey) — available from Amazon
- Extrapolation Factory Operator’s Manual (Elliott P. Montgomery and Chris Woebken) — available from Amazon
And there’s some interesting papers and academic articles we think you might be interested in, if you enjoyed our talk:
- Hopes and fears for intelligent machines in fiction and reality (Stephen Cave and Kanta Dihal) — available from Nature Machine Intelligence
- Long-Term Trends in the Public Perception of Artificial Intelligence (Ethan Fast and Eric Horvitz) — available from arXiv
- “Scary Robots”: Examining Public Responses to AI (Stephen Cave, Kate Coughland, and Kanta Dihal) — available from AIES Conference