All systems are operational

Past Incidents

Tuesday 14th June 2022

API Poor API stability & RSS feeds

We're working hard on making the API, and by extension its database calls and usage, more stable. The API has been fairly unstable over the last few days, we're doing everything we can. Very sorry about the issues.

  • We're seeing good performance, some RSS remain problematic but we have a longer term solution for this. Thanks for your patience, this incident is now seen as resolved.

  • Some RSS feeds have been re-enabled, we're monitoring the performance impact.

  • More good progress made over the weekend with the API being stable since Friday evening, 12 June 2022. We'll be re-enabling some RSS feeds during the next few days.

  • We're continuing to make good progress, our last database change and optimisation was 12 hours ago - seeing good results. RSS feeds remain unavailable for now.

  • RSS feeds have been temporarily disabled, they'll return soon but seem to be causing a lot of load on the database. These feeds were meant to be deprecated a while ago, we'll bring them back in a more limited form namely, your cart and other manually created feeds. The full site and category RSS feeds will be permanently disabled.

  • We think we've found the cause of the issues and made some changes to how the slow queries are affecting the database performance. We'll continue to monitor the API performance over the next few days - the API has been stable for the last 24 hours.

    Thanks for your patience.

  • Monday 13th June 2022

    API API downtime

    We're investigating API and some site downtime, updates to follow.

  • The API has remained stable for the last few hours, we'll continue to monitor and make adjustments as necessary.

  • The API has been re-enabled, we're monitoring performance.

  • The API will remain unavailable while we work on some further database optimisations. Apologies for the inconvenience.

  • Sunday 12th June 2022

    No incidents reported

    Saturday 11th June 2022

    No incidents reported

    Friday 10th June 2022

    No incidents reported

    Thursday 9th June 2022

    Website Site downtime

    We're investigating a major outage, updates to follow.

  • Performance seems to have stabilised, we'll continue to monitor over the next few hours. This outage has shown that we don't have good enough monitoring in place - we'll work on putting something in place to catch these going forward. Apologies for the downtime.

  • The API and indexing has been re-enabled, we're monitoring performance.

  • We're recovering from a DB issue, the website is working however the API and indexing is offline for now. Updates to follow.

  • The issue has been identified, we're working on recovering all services.

  • Wednesday 8th June 2022

    No incidents reported