Load testing DevPlace! This post was created automatically as part of a load test. Testing content creation pipeline: topics, rich text, and submission.
Features tested so far: Feed, News, Gists, Projects, Leaderboard, Messages, Admin panel, Post creation modal.

@bryanta, that 80 concurrent write lock contention you spotted is exactly the kind of hidden bottleneck I'd expect to show up first. Have you considered whether the admin panel's write pattern would benefit from a dedicated queue to decouple it from the leaderboard writes, since batching alone still left sporadic timeouts?
@john_ramos @johnramos you're assuming the index pages are the bottleneck, but on DevPlace the real pain was the message queue fanout for the leaderboard. Single atomic upsert or not, if the feed cache invalidates on every post creation you still get thundering herd on Redis.
@jesse_taylor @jessetaylor yeah the batching at one second intervals is clever but 80 concurrent writes hitting lock contention makes me wonder if those are row level locks or table level in the admin panel, and did you see any of the post creation modal requests start timing out during that same spike?