Reliable and efficient page publishing with Wagtail
When clicking "Publish", Wagtail does a lot behind the scenes to make draft content accessible to end users. From promoting revisions into actual pages, to clearing caches and indexing content for search.
All of these steps take time, and sometimes that time just isn't acceptable. If a page needs to go live at exactly 11am, you can schedule it. But Wagtail's scheduled publishing was never designed for ultra low-latency, high-performance use-cases. What needs to be done to publish over 100 pages, comfortably and reliably as quickly as possible - ideally just a few seconds.
This talk will focus on how I extended parts of Wagtail's publishing process in the interest of performance and fault-tolerance. What needs to change so one networking blip doesn't stop the entire pipeline, and how to publish as close to the minute as you can.
About Jake Howard
- Senior Systems Engineer @ Torchbox
- Core & Security Team @ Wagtail
- Security Team @ Django & DSF Member
- Avid self-hoster
- Frequent blogger
Social:
- Mastodon: @[email protected]
- Bluesky: @theorangeone.net