The situation appears to be resolved. Here is the update from Cloudflare:
"A fix has been implemented and we believe the incident is now resolved. We are continuing to monitor for errors to ensure all services are back to normal."
Here is our post-mortem.
We continue to monitor the situation. The system is still experiencing intermittent status.
System status is intermittent. Most likely due to Cloudflare trying to recover. We'll keep monitoring. Below is the update from Cloudflare:
"We are seeing services recover, but customers may continue to observe higher-than-normal error rates as we continue remediation efforts."
All services seem to be back. Although we are not sure yet what has happened, since Cloudflare's incident report has not been updated.
Weโre currently experiencing a global service outage because our infrastructure provider is having technical issues. This is affecting our ability to deliver the app as usual. Weโre closely monitoring the situation and will restore service as soon as our provider resolves the issue. Thank you for your patience and understanding. You can also follow the situation directly on Cloudflare's incident report.
There is a global outage affecting all users at this time. Our app, APIs, documentation are all currently not accessible. We are investigating and will provide updates about the situation here as soon as we have some.
The fix is now live in release v2.32.1
What happened? The space.getDefinition method was accidentally removed from smplr.js, our Javascript library.
Context: This method was a temporary internal hack, which we do not rely on anymore. So it was deleted. It was not documented, and we did not realize users may find it through the library's types. However, some users did, and this resulted in integration malfunction โ we're sincerely sorry for this oversight.
Resolution: The method has now been added back, made part of the library officially, and documented.
Thank you Milan for the report and your understanding ๐.
We have identified the issue and are preparing a fix. It should be live within 20 minutes.
Timing of events (UTC time)
- [3:15am] The method was removed in release v2.32.0.
- [9:26am] We received a report of the issue.
- [9:30am] We responded to the report.
We have received a report that the space.getDefinition method is not available anymore in smplr.js, our Javascript library. We're investigating it.