Sitecore Cloud - Status Page Last updated 1 seconds ago
Scheduled Events

  Dec 13, 2018

Sitecore Email Cloud Connector Maintenance

Estimated time frame: Dec 13, 11:00 - Dec 13, 12:30 UTC

Sitecore Cloud Operations team will perform maintenance on Sitecore Email Cloud Connector Service.

 

No impact expected on customers using Email Cloud Service.


- Posted on Dec 13, 11:00 UTC

Identified: Planned service maintenance window for Email Cloud Connector Service.
- Posted on Dec 10, 00:00 UTC

All Past Events

  Dec 06, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Commerce 9.0 Update-3 for Sitecore 9.0 Update-2
  • Storefront 1.0 Update-3 for Sitecore 9.0 Update-2
  • SPA bug fixes
    • SAS token for arm modules parameters is not same as module arm template link SAS token
    • Certificate control bundle fields does not validate CommonName and Password field

- Posted on Dec 06, 00:30 UTC

COMPLETED: This upgrade has been successfully performed on production
- Posted on Dec 06, 13:45 UTC

IN PROGRESS: Production upgrade using latest product release packages is in progress.
- Posted on Dec 06, 01:18 UTC

STARTED: The deployment on to the production environment has been started
- Posted on Dec 06, 00:52 UTC

Identified: 
- Posted on Dec 05, 00:00 UTC

  Dec 04, 2018

Intermittent Network Degradation - South Central US

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified an alert which we would like to bring to your attention.

Affected Sitecore Cloud Service: Sitecore Managed Cloud - Customer

Customer identification: The South Central US Managed Cloud Customers

Issue description: As per Azure communication, the South Central US Managed Cloud Customers might have experienced degraded performance, network drops or time outs when accessing Azure resources hosted in this region. Applications and resources that retried connections or requests may have succeeded due to multiple redundant network devices and routes available within Azure data centers.

Impact: Degraded Performance, network drops or time outs when accessing Azure resources in the South Central US Data Center.

Additional references:  https://azure.microsoft.com/en-us/status/history/

Date identified: Between 02:48 UTC and 04:52 UTC on 04 Dec 2018

Date resolved: 04 Dec 2018 at 04:52 UTC 

Planned further actions: Azure Engineers are continuing to investigate & establish the full root cause. A full Root Cause Analysis should be updated in approximately 72 hours on the above Azure reference link.

Who performs further actions: Azure

Next update planned at: No further updates


- Posted on Dec 04, 02:48 UTC

RESOLVED: As per Azure, this issue is now resolved.
- Posted on Dec 04, 06:35 UTC

Identified: 
- Posted on Dec 04, 00:00 UTC

  Nov 29, 2018

Elevated 5xx errors and latency increase for Email Cloud Sparkpost US customers

Sparkpost reported an elevated level of API errors and latency APIs for some US customers on 28 Nov 2018 20:30 - 21:44 UTC.
If you got any errors while sending emails during issue time-frame, please try again.
Note: This issue does not impact our Sparkpost Enterprise customers hosted in the EU.

More details on Sparkpost status page: https://status.sparkpost.com/incidents/h27bwxyy4gy2


- Posted on Nov 28, 20:30 UTC

Resolved: Sparkpost reported that issue was resolved on 28 Nov 2018 21:44 UTC
- Posted on Nov 29, 02:40 UTC

  Nov 27, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: 
No impact to existing Sitecore Customer's Cloud resources.

Release Highlights:

  • New Sitecore release  with modules:
    • CDN 1.0.0
    • JSS 11.0.0
    • SXA 1.8.0
    • Salesforce 1.0.0
  • SXA Compatibility update:
    • Sitecore 9.0.2 supports SXA 1.8 instead 1.7.1
  • An Option added to Marketplace to switch On/Off Application Insight in the Sitecore 9.1.0 deployment
  • An new option added to Marketplace to provision CDN as a part of the Sitecore deployment or Customer use their existing CDN
  • Added "patches" arm templates folder support in Storage API Upload Endpoint

- Posted on Nov 26, 09:00 UTC

FINISHED: The update has been completed successfully.
- Posted on Nov 27, 13:27 UTC

STARTED: The Core service update has been started.
- Posted on Nov 26, 09:00 UTC

  Nov 20, 2018

AppCenter connection problems

Some users may experience problems while accessing AppCenter from Sitecore Control Panel. Sitecore team is already looking into the issue.


- Posted on Nov 20, 03:00 UTC

Resolved: 

One of our underline subsystems has failed which led to AppCenter connection issues.

Right now all systems are back to normal state and AppCenter is operating normally.

All customers should be able to access AppCenter now.


- Posted on Nov 20, 08:58 UTC

Identified: AppCenter users are not able to login or view any data.
- Posted on Nov 20, 03:49 UTC

  Nov 13, 2018

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 1.6.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Managed Cloud Core services and Consumption Billing.

Impact on Customers: No downtime and no impact on live customer solutions expected.

Release summary:   

Bug 249706

PBI 229838

PBI 206473

PBI 161233


- Posted on Nov 12, 13:30 UTC

FINISHED: The Update has been finished successfully.
- Posted on Nov 13, 13:41 UTC

STARTED: The update has been started.
- Posted on Nov 12, 13:30 UTC

  Nov 12, 2018

Sitecore App Center - Planned Upgrade with New Features & Bug fixes

Release summary:

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.329, 0.333, 0.3331  along with some New features & Bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore Managed Cloud.

  • Removing dependency on Silverlight – Impersonate Management User into SPEAK.
  • Support download of consumption details in Managed Cloud.

Impact on Customers:    No impact on live customer solutions expected.


- Posted on Nov 12, 13:00 UTC

Finished: The Update has been completed successfully.
- Posted on Nov 12, 15:33 UTC

Identified: 
- Posted on Nov 08, 00:00 UTC

  Nov 08, 2018

Sitecore Managed Cloud Subscriptions Update

Updating Azure Subscriptions setup for all Managed Cloud customers to comply with latest update to Access Policy published here: https://kb.sitecore.net/articles/133931. No impact and no service interruptions are expected.


- Posted on Nov 29, 14:00 UTC

Identified: 

Access Policy published here: https://kb.sitecore.net/articles/133931.


- Posted on Nov 08, 00:00 UTC

  Oct 31, 2018

181026 App Center - Internal Dependent System Update

An internal dependent system related to the App Center requires an update.  There is a possibility that the App Center could be affected by this update.  However, we don't expect that the update will have any impact on App Center customers.
- Posted on Oct 28, 01:00 UTC

Resolved: 

Sitecore Cloud Operations team were able to deploy the hotfix which resolved the reported issues.Post deployment validations and smoke tests passed successfully.


- Posted on Oct 31, 13:47 UTC

Update: 

Sitecore Cloud Operations team have Identified issues which will prevent customers from logging in to The Sitecore App Center UI. The reported issues will not prevent customers from using the other services.


- Posted on Oct 29, 13:53 UTC

Identified: We have been alerted that this system update will take place on 28-Oct-2018 from 01:00 am to 01:00 pm UTC.
- Posted on Oct 26, 17:04 UTC

  Oct 30, 2018

Scheduled Maintenance for Status Page

 Sitecore Cloud Status page will be down for 2 hours for scheduled maintenance starting at 2018-11-06 22:00:00 UTC. During this time, the following instances will be unavailable.

We perform maintenance regularly to ensure the service runs stably and securely for our customers.


- Posted on Nov 06, 22:00 UTC

Identified: We have been alerted that this system update will take place on 2018-11-06 22:00:00 UTC. Status Page will be unavailable During maintenance period. 
- Posted on Oct 30, 00:00 UTC

  Oct 25, 2018

xDB Cloud resource connectivity issues in West US

Beginning at approximately 22:40 UTC on 24 Oct 2018, xDB Cloud customers in West US may have experienced issues connecting to their Azure and MongoDB resources.
- Posted on Oct 24, 22:40 UTC

Resolved: 

As of 00:03 UTC 24-Oct-2018, Azure engineers have restored the affected services.

For additional root cause information, please see the Azure status page.


- Posted on Oct 25, 00:03 UTC

Identified: 
- Posted on Oct 25, 00:00 UTC

In Progress: 

Azure engineers are working to resolve the issues with the West US resources.

Please see updates here: Azure Status page


- Posted on Oct 24, 23:30 UTC

  Oct 22, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: 
No impact to existing Sitecore Customer's Cloud resources.

Release Highlights:

  • UI Fixes on Summary Page for selected modules
  • Fixed modules list when all modules is not selected
  • Fixed Additional Deployment Inclusion Control Bundle does not reflect on arm response
  • Fixed Certificate Control Bundle, download link return ByteArray content instead of Base64 content

 


- Posted on Oct 19, 10:00 UTC

COMPLETED: 

The release packages for the Market place core services upgrade have been successfully deployed  on the production infrastructure.

All the post deploy validations have also passed.


- Posted on Oct 22, 22:02 UTC

IN PROGRESS: The deployment of new release packages for upgrade is in progress on production infrastructure.
- Posted on Oct 22, 21:40 UTC

STARTED: The upgrade has now been started on production marketplace.
- Posted on Oct 22, 21:38 UTC

SCHEDULED: This upgrade has now been scheduled for deployment.
- Posted on Oct 19, 10:07 UTC

Identified: 
- Posted on Oct 19, 00:00 UTC

  Oct 22, 2018

xDB Cloud Core Services Release 2.0.2.9 Update

Sitecore Cloud Operations team is preparing the following planned Release 2.0.2.9 to xDB Cloud Core Services.

Impact on Customers: No downtime and no impact on live customer solutions expected.


Release summary: Internal improvements and fix bugs. 
- Posted on Oct 19, 09:30 UTC

Finished: The Update has been completed successfully. 
- Posted on Oct 22, 07:00 UTC

Update: The update has been started.
- Posted on Oct 19, 00:00 UTC

  Oct 04, 2018

Sitecore Appsource Test Drive failing

Issue Description:

The ability to spin up Sitecore XP Test Drive instances through Sitecore Appsource  is currently stalled.

Unable to spin up the Sitecore XP Test Drive instances (8.2.4) through the Sitecore App source.

Impact on End Users:

Although the users may submit the request for Test Drive instances , it fails after sometime stating that App source is experiencing problems & hence to try later.

This failure is due to failing deployments of the Sitecore XP on Azure.

The deployments are failing because,  one of the Site Extension(Sitecore.AppSource.SiteExtension) we are using in AppSource deployment is no longer available

 

Exact Sitecore version:  Sitecore XP Test Drive instances (8.2.4)

Planned further actions:

Sitecore is working actively to migrate & then configure the Sitecore.AppSource.SiteExtension to nuget.org  and make it available to the Azure Test Drive App source engine during deployments.

 

Next update planned at:

Cloud Operations will provide an update to this status page item , once the issue has been resolved & verified that the Sitecore XP Test Drive instances can be spun again successfully from App source.


- Posted on Sep 17, 01:00 UTC

RESOLVED: This issue has now been resolved & we have verified that the Sitecore XP Test Drive requests are now successful through AppSource.
- Posted on Oct 04, 06:46 UTC

Identified: 
- Posted on Sep 30, 00:00 UTC

IN PROGRESS: Sitecore is working actively to migrate & then configure the Sitecore.AppSource.SiteExtension to nuget.org  and make it available to the Azure Test Drive App source engine during deployments.
- Posted on Sep 26, 13:00 UTC

Identified: Sitecore  XP Test Drive failing through Appsource
- Posted on Sep 17, 01:00 UTC

  Oct 03, 2018

Sitecore App Center - Planned Upgrade with New Features & Bug fixes

Release summary:

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.324, 0.325, 0.326, 0.327, 0.328 along with some New features & Bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore Email Cloud, Sitecore Managed Cloud.

  • Managed Cloud App updates to support past period consumption and display account name in page header.
  • Fixed Manage Cloud App bugs.
  • App center Login: Remove requirements for fields in CRM Account.
  • One Bug fixed include :  Managed Cloud UI App breaks up when Slot has no Metric instances.
  • One of the many bugs fixed include : Managed Cloud Consumption App Not Visible to Customers.

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.


- Posted on Sep 30, 15:00 UTC

COMPLETED: 

The production app center servers are now successfully updated with these release packages.

All the relevant post deploy validations & various smoke tests have passed positively.


- Posted on Oct 03, 10:01 UTC

IN PROGRESS: The Sitecore App center upgrade process through deployment of the new release packages has been started.
- Posted on Oct 01, 14:03 UTC

Scheduled: Upgrade has been scheduled.
- Posted on Sep 30, 12:35 UTC

Identified: 
- Posted on Sep 30, 00:00 UTC

  Oct 01, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: 
No impact to existing Sitecore Customer's Cloud resources.

Release Highlights:

·         Enable TLS 1.2 for Sitecore 8.2.x line

·         Set Marketplace API to TLS min version as 1.0

·         Update Marketplace assemblies and package versions to 2.x.x

 


- Posted on Oct 02, 00:30 UTC

Update: The update has been started.
- Posted on Oct 01, 12:54 UTC

Update: 

The update put on-hold till the next week.


- Posted on Sep 26, 00:00 UTC

  Sep 24, 2018

Email Cloud Sparkpost Errors

Some Email Cloud customers may experience 5xx errors during email injections

Sitecore team have identified the root case of the issue. We are working on identifying the full impact. 


- Posted on Sep 24, 11:30 UTC

Resolved: The issue has been resolved. 
- Posted on Sep 24, 12:30 UTC

Identified: Sitecore team have identified  issues with the Email Cloud Service.
- Posted on Sep 24, 11:30 UTC

  Sep 07, 2018

Managed Cloud - Azure South Central US location multiple services connection problems

Azure reported that starting from 09:26 UTC 04 Sep 2018 multiple services in South Central US region may be inaccessible, more details on https://azure.microsoft.com/en-us/status/

Managed Cloud customers may experience problems while accessing resources in Azure Portal, also all Azure resources like Web Apps, SQL databases, storage etc. and Mongo databases connection may fail by timeout for the South Central US region.

xDB Cloud 1.0 customers may also experience connection problems from multiple locations.

Sitecore team will keep monitoring and updating the status.


- Posted on Sep 04, 09:26 UTC

Resolved: Azure reported that all services are now restored.
- Posted on Sep 07, 11:13 UTC

Mitigated: 

Azure engineers report that most of the services have been restored. All Managed Cloud and xDB Cloud customers shouldn't have any issues, however Azure engineers haven't yet restored Storage services in South Central US.


- Posted on Sep 06, 11:49 UTC

Azure engineering status update: 

Azure Engineers have restored storage availability for the majority of impacted services, and customers should be continuing to see improvements to service availability.

Azure Engineers are continuing to work on any residual storage impact to fully mitigate this issue.



- Posted on Sep 05, 13:00 UTC

Azure engineering status: Azure Engineers are prioritizing the restoration of Storage resources in order to recover all services with dependencies on these impacted resources.  As storage mitigation continues to progress, a necessary extended mitigation phase is required. 

- Posted on Sep 05, 11:06 UTC

Update: Azure Support Engineers continue to focus on the restoration of Storage-related resources as a majority of services still impacted are dependent on this service.

The next update will be provided by 11:00 UTC 05 Sep 2018 or as events warrant.
- Posted on Sep 05, 06:37 UTC

In Progress: Sitecore team have identified that xDB Cloud 1.0 customers may also experience connection timeouts. We are working on identifying the full impact.
- Posted on Sep 04, 14:10 UTC

Identified: Azure support has identified the root cause which was in a localized cooling system failure and working on the solution.
- Posted on Sep 04, 13:41 UTC

  Sep 04, 2018

Sitecore Managed Cloud - Azure App Service upgrade to .NET Framework 4.7.2

Sitecore Cloud Operations team brings to your notice the below Planned Azure App services upgrade:

Affected Sitecore Cloud Service: Sitecore Managed Cloud (Any Topology).

Maintenance Upgrade Summary: 

We have received notifications from Microsoft that they will be rolling out .NET 4.7.2 across all Azure App Service instances in September, 2018, this is not an optional rollout. 
The Azure app service apps for the Sitecore Managed cloud environments will be upgraded to the .NET Framework 4.7.2 update.
Since the release is backwards compatible any existing Sitecore instances should be free from issues. 
We have reviewed the Release Notes - there are no breaking changes for applications targeting previous versions (4.5, 4.6, 4.7.1) and since Sitecore explicitly includes target framework in the httpRuntime/targetFramework attribute, and is compiled for previous versions of .NET Framework, there shouldn’t be any change to our services. 

Expected impact on customers: 

As per Azure , there should not be any service interruptions associated with this update for the various Sitecore Managed Cloud environments.
However, this status update will serve as a heads up notification , since the upgrade will be performed on the Sitecore Managed Cloud Azure App Services.

When ? :  Update scheduled throughout the month of SEP-2018.

Release details:

Please refer to below for complete details about this release:

1) .NET Framework 4.7.2 release announcement

2) https://github.com/Azure/app-service-announcements/issues/89 

3) https://blogs.msdn.microsoft.com/dotnet/2018/04/30/announcing-the-net-framework-4-7-2/ 


- Posted on Sep 01, 00:30 UTC

In Progress: This upgrade will be in progress throughout the month of September - 2018
- Posted on Sep 04, 21:12 UTC

Identified: 
- Posted on Sep 04, 00:00 UTC

  Aug 31, 2018

Email Cloud Sparkpost SMTP API errors and latency

Some customers may experience 5xx errors and increased latency during email injections. Please retry later any 5xx error.

Note: Customers who use Sparkpost EU are not affected.

More details on Sparkpost status page: https://status.sparkpost.com/
- Posted on Aug 31, 20:53 UTC

Resolved: The issue has been resolved.
- Posted on Aug 31, 23:31 UTC

Identified: 
- Posted on Aug 31, 00:00 UTC

  Aug 21, 2018

Email Cloud Sparkpost SMTP API errors and latency

Some customers may experience 5xx errors and increased latency during email injections. Please retry later any 5xx error.

Note: Customers who use Sparkpost EU are not affected.

More details on Sparkpost status page: https://status.sparkpost.com/


- Posted on Aug 21, 11:30 UTC

Resolved: The incident has been resolved.
- Posted on Aug 21, 13:23 UTC

Identified: Incident has been identified.
- Posted on Aug 21, 11:30 UTC

Identified: 
- Posted on Aug 21, 00:00 UTC

  Aug 20, 2018

App Center - Delays regarding access requests to App Center

Due to update process in the internal system, requests regarding access to App Center (e.g. to activate IP Geolocation or to access Managed Cloud Consumption App) might be processed with delays. We are working on our side to overcome all the delays in the most efficient manner.
- Posted on Jul 17, 01:00 UTC

Resolved: All potential delays have been mitigated internally, so system is back into regular operations
- Posted on Aug 20, 01:00 UTC

Identified: The maintenance entry has been created
- Posted on Jul 17, 01:00 UTC

  Aug 15, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release Highlights

·        Commerce 9.0.2 Release (currently available with Azure Search provider only).

·        Storefront 1.0.2 Release.


- Posted on Aug 14, 12:00 UTC

Finished: The update has been completed.
- Posted on Aug 15, 07:36 UTC

Update: The update has been started.
- Posted on Aug 14, 00:00 UTC

  Aug 06, 2018

Sitecore Email Cloud - Subscription Error

Customers using EXM  might get an error alert"An error occurred " when they Open the subscription tab Under Administrator on EXM.

In the Logs, you might find the following exception  “The model backing the 'FrameworkDbModel' context has changed since the database was created.”

We have identified the root cause of the issue and we are working on the resolving the issue.


- Posted on Aug 03, 00:00 UTC

MITIGATED: This issue has been successfully mitigated.
- Posted on Aug 06, 14:19 UTC

Identified: Exception was Identified  “The model backing the 'FrameworkDbModel' context has changed since the database was created.”
- Posted on Aug 03, 00:00 UTC

  Aug 03, 2018

xDB Cloud Core services upgrade

Sitecore Cloud Operations team is preparing a planned upgrade of xDB Cloud Core services.

No impact on customers expected.


- Posted on Aug 03, 09:00 UTC

UPDATE: The upgrade has been completed successfully.
- Posted on Aug 03, 11:51 UTC

Identified: The upgrade has been started.
- Posted on Aug 03, 00:00 UTC

  Aug 02, 2018

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.318.0, 0.319.0.321,0.322 &  0.323.0 along with some bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore App center SPEAK UI , Sitecore Managed Cloud and Sitecore IP Geolocation offering.

Release Notes:

  • Release 0.318.0: Framework 4.0.1702,Framework.Items 4.0.1702, Framework.Api 4.0.1702
  • Release 0.319.0: Sitecore.Apps.ManagedCloud 1.0.451
  • Release 0.321.0: Sitecore.Apps.IP Geolocation 3.0.23
  • Release 0.323.0: Sitecore.EmailCloud 3.0.279
  • Various updates for improved Sitecore internal applications

Impact on customers during deployment: No customers impact is expected, App Center services will be restarted after the Deployment.


- Posted on Aug 02, 09:00 UTC

Finished: This planned update has been completed successfully
- Posted on Aug 02, 11:15 UTC

Identified: Maintenance Window is required for Sitecore App Center Updates with Bug fixes
- Posted on Jul 31, 09:00 UTC

  Jul 27, 2018

Multiple Sitecore Cloud Services Failures

Between 22:15 on 26 July 2018 and 06:20 UTC on 27 July 2018 our Sitecore Managed Cloud, xDB Cloud, Email Cloud and Geo IP customers could have experienced timeouts or an outage while using these services. List of impacted resources: Azure SQL Databases, Azure Storage, Azure Search, Azure Active Directory B2C, Azure Cloud Service, Azure App Service. Right now the incident has been resolved.
- Posted on Jul 26, 22:30 UTC

Identified: The Sitecore Cloud team identified the issue during monitoring. Azure confirmed the outage, more details on the Azure status page: https://azure.microsoft.com/en-us/status/history/. Our team is working on impact identification and mitigation plan.
- Posted on Jul 27, 10:00 UTC

  Jul 26, 2018

Email Delivery Service retired TLS v1.0

On 23 July 2018, SparkPost deprecated TLS v1.0. This caused because of Email Delivery Service unavailability for Sitecore solutions running on .NET Framework 4.5.2.

 


- Posted on Jul 23, 02:30 UTC

SOLUTION: The issue description with a solution details is available at  https://kb.sitecore.net/articles/941637
- Posted on Jul 26, 00:00 UTC

  Jul 25, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources. However, during the data upload of the new web deploy packages, new Sitecore Experience Cloud instances cannot be deployed using Azure Marketplace.

 

Release summary:

·         Enable SXA 1.7.1 for Sitecore 8.2 Update-7 Developer configuration

·         Enable SXA 1.7.1 for Sitecore 9.0 Update-2 Developer configuration

·         Update EXM DDS user interface


- Posted on Jul 24, 14:00 UTC

Finished: This planned update has been completed successfully.
- Posted on Jul 25, 09:13 UTC

Update: This Marketplace upgrade is in progress.
- Posted on Jul 24, 00:00 UTC

  Jul 16, 2018

Sitecore Azure Cloud resources down in West US and West Central US

Starting 16:00 UTC, our Sitecore Managed Cloud, xDB Cloud, Email Cloud and Geo IP customers in West US, West Central US and Australia East may experience an outage with their solutions. Resources directly impacted: Azure App Service, Azure SQL Databases, Azure Storage. Our team is validating exact impact and the mitigation plan. Further updates will be posted there.

 


- Posted on Jul 16, 16:00 UTC

Mitigated: 

As per the latest Azure status, this issue has been successfully mitigated.

Source : https://azure.microsoft.com/en-us/status/history/ 


- Posted on Jul 16, 18:15 UTC

Identified: The issue has been identified by the monitoring alerts on particular Web Apps in the affected region. Azure monitoring confirms the outage: https://azure.microsoft.com/en-us/status/. Our team is working on impact identification and mitigation plan.
- Posted on Jul 16, 16:00 UTC

  Jul 13, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources. However, during the data upload of the new web deploy packages, new Sitecore Experience Cloud instances cannot be deployed using Azure Marketplace.

Release summary:

1) Enable SXA 1.7.1 for Sitecore 8.2 Update-7  
2) Enable Solr as Search Provider for Sitecore 8.2 Update-7
3) Azure Search Replica Count Parameterization for Sitecore 8.2 Update-7
4) Salesforce 1.0 Initial Release for Sitecore 9.0 Release, 9.0 Update-1, and 9.0 Update-2
5) Removed SXA 1.7.1 xPSingle and xMSingle in Sitecore 9.0 Update-2
6) SPA bug fixes - 
o Region tab location dropdown is not persisted
o Azure Portal 'OK' Button is not enabled when navigate through tabs
o Speak package dependencies set to specific version 

 

- Posted on Jul 12, 06:00 UTC

COMPLETED: This maintenance upgrade has been successfully completed on Azure Marketplace.
- Posted on Jul 13, 05:52 UTC

IN PROGRESS: This Marketplace upgrade is in progress.
- Posted on Jul 12, 09:39 UTC

STARTED: This upgrade has been started.
- Posted on Jul 12, 08:35 UTC

Identified: 
- Posted on Jul 12, 00:00 UTC

  Jul 04, 2018

Deployment - API Management services for Sitecore Email Cloud Connector

Sitecore Cloud Operations team has started a deployment of API Management services for Sitecore Email Cloud Connector. 

Affected Sitecore Cloud Service:  Sitecore Email Cloud

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.


- Posted on Jul 03, 00:00 UTC

Completed: This planned deployment has been completed successfully.
- Posted on Jul 04, 17:59 UTC

Started: Planned deployment has been started
- Posted on Jul 03, 08:30 UTC

  Jul 04, 2018

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 1.5.1.0 to Sitecore Managed Cloud Services.
This upgrade brings couple of new features and fixes some issues.

Affected Sitecore Cloud Service: Managed Cloud Core services and Consumption Billing.

Impact on Customers: No downtime and no impact on live customer solutions expected.

Release summary:   

1. Improve UsagePopulation scheduler - run for current and previous month
2. Enhance historical usage service for App Center
3. Billing should not calculate Overage Quota based on slot start date
4. Update billing .NET framework and project folder
5. Update RackspaceMonthlyBillings table schema


- Posted on Jul 04, 05:00 UTC

COMPLETED: This planned upgrade has been completed successfully.
- Posted on Jul 04, 10:18 UTC

IN PROGRESS: This planned upgrade is in progress.
- Posted on Jul 04, 09:19 UTC

STARTED: Planned Upgrade has been started
- Posted on Jul 04, 08:32 UTC

Identified: 
- Posted on Jul 04, 00:00 UTC

  Jun 28, 2018

28 June 2018 Managed Cloud Infrasturcture Alert

Issue Description: subset of Managed Cloud customers in the West Europe region may have experienced difficulties connecting to App service resources with HTTP 500-level response codes. As per Microsoft Azure, this issue started happening at 16:00 UTC on 27 Jun 2018.

Impact:

Users trying to access the App Services in West Europe region may have received HTTP 500-level response codes, experienced timeouts or high latency when accessing App Service deployments hosted in these regions. 

Source:  https://azure.microsoft.com/en-us/status/  

Sitecore Cloud Engineers will keep monitoring this Azure alert as well the impacted managed cloud services and provide an update once the issue is resolved.


- Posted on Jun 27, 16:00 UTC

Mitigated: 

As per the latest Azure status, this issue has been successfully mitigated.

Source : https://azure.microsoft.com/en-us/status/history/ 


- Posted on Jun 28, 12:35 UTC

Mitigation: 

As per Microsoft, Azure Engineers have identified a possible underlying cause, and are working to determine mitigation options.

We will monitor their updates and provide status updates to this event accordingly.


- Posted on Jun 28, 04:00 UTC

Identified: This App service issue affecting certain Managed cloud West Europe Region customers has been identified.
- Posted on Jun 28, 01:30 UTC

  Jun 26, 2018

Managed Cloud Infrasturcture Alert

Issue Description: subset of Managed Cloud customers in the South Central US may have experienced difficulties connecting to resources and/or 500-level errors hosted in this region

Impact:

Virtual Machines may have rebooted unexpectedly.

Impacted services included:  App Service (Sitecore instances runtime) and also App Insights (Sitecore logging functionality) and Redis cache (Sitecore session state functionality in XP topology).

More details: https://azure.microsoft.com/en-us/status/history/

Sitecore Cloud Engineers will keep monitoring managed cloud services and provide an update once the issue is resolved.


- Posted on Jun 25, 19:40 UTC

Mitigated: Azure Engineers  have applied mitigation on the scale unit to prevent this from recurring while continuing to investigate full root cause, validating that this was isolated to a single scale unit.
- Posted on Jun 26, 05:55 UTC

Identified: 

Sitecore Cloud team have monitored the following Azure Outage:

Between 19:40 and 19:41 UTC on 25 Jun 2018, a subset of customers in South Central US may have experienced difficulties connecting to resources and/or 500-level errors hosted in this region.


- Posted on Jun 25, 07:40 UTC

  Jun 21, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources. However, during the data upload of the new web deploy packages, new Sitecore Experience Cloud instances cannot be deployed using Azure Marketplace.

Release summary:

  • Sitecore 9.0.2
  • SXA 1.7.1
  • WFFM 9.0.2
  • Enable Solr as Search Provider
  • Azure Search Replica Count Parameterization    

 


- Posted on Jun 20, 00:00 UTC

COMPLETED: This planned upgrade maintenance is now complete.
- Posted on Jun 21, 09:21 UTC

IN PROGRESS: The deployment and upgrade has been started.
- Posted on Jun 20, 09:05 UTC

Identified: 
- Posted on Jun 20, 00:00 UTC

  Jun 20, 2018

Managed Cloud Infrastructure Alert

A subset of customers in the North Europe region may experience difficulties connecting to their resources or performance degradation. Live solution not affected.

More information is available at the Microsoft Azure status page - https://azure.microsoft.com/en-us/status


- Posted on Jun 19, 17:44 UTC

MITIGATED: 

MS Azure Engineers have addressed the temperature issue, and performed a structured of the affected devices and the affected downstream services.

The issue has been mitigated.

Please refer : https://azure.microsoft.com/en-us/status/history/  &  https://azure.microsoft.com/en-us/status/


- Posted on Jun 20, 06:16 UTC

Identified: 19-Jun-2018, 17:44 UTC
- Posted on Jun 19, 00:00 UTC

  Jun 19, 2018

Deployment - Sitecore Azure Marketplace ARM templates update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

There are no updates to the Sitecore Marketplace core services or the API /SPA.

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

1) CM AppService plan Size changed to B3 on Sitecore 9.0.0 and 9.0.1

2) New product package deployment which contains ARM template changes for the Sitecore 9.0.0-Sitecore 9.0.1


- Posted on Jun 18, 00:00 UTC

COMPLETED: The data upload of the deploy package has been successfully completed & all the post deploy validations have been tested positively.
- Posted on Jun 19, 11:22 UTC

STARTED: The deployment of the ARM template changes has been started.
- Posted on Jun 19, 11:20 UTC

Identified: 
- Posted on Jun 19, 00:00 UTC

  Jun 10, 2018

Managed Cloud Infrastructure Alert

A subset of customers in the West Europe region may experience difficulties connecting to their resources or performance degradation.

More information is available at the Microsoft Azure status page - https://azure.microsoft.com/en-us/status/


- Posted on Jun 10, 04:00 UTC

Resolved: Issue has been mitigated by Microsoft Engineers.
More details: https://azure.microsoft.com/en-us/status/history/

 

- Posted on Jun 10, 10:51 UTC

Identified: 10-Jun-2018, 05:00 UTC
- Posted on Jun 10, 05:00 UTC

  May 31, 2018

Managed Cloud Infrasturcture Alert

subset of Managed Cloud customers may have experienced intermittent errors when changing infrastructure via Azure Portal. Live solution not affected.

More details: https://azure.microsoft.com/en-us/status/history/

Sitecore Cloud Engineers will keep monitoring managed cloud services and provide an update once the issue is resolved.


- Posted on May 30, 21:45 UTC

Identified: 
- Posted on May 31, 00:00 UTC

Resolved: 

Issue has been resolved by Microsoft Engineers.

More details: https://azure.microsoft.com/en-us/status/history/


- Posted on May 30, 23:50 UTC

  May 29, 2018

Sitecore App center access issue

Issue: The Sitecore App center is unavailable, due to Sitecore internal network issue.

Impact on Customers: Sitecore customers/partners won't be able to access App center.

Actual impact is that the customers/partners/sitecore account managers won't be able to view the consumption details of IP Geolocation, Sitecore Email Cloud & Sitecore Managed cloud.

Also, purchasing of a new pricing plan / subscribing to a new Sitecore cloud service / changing the existing price plan is affected.


- Posted on May 29, 13:50 UTC

Resolved: Network issue has been resolved by Sitecore engineers. App Center is in healthy state and operating normally again.
- Posted on May 29, 17:41 UTC

Identified: Unable to login to the Sitecore App center, due to Sitecore internal network issue. Sitecore engineers are working on resolve the issue. 

Updates will be posted as soon as they are available.


- Posted on May 29, 00:00 UTC

  May 27, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • Marketplace UI Changes -
    1. The Generic Important Notice messages are displayed in all the tabs, on top of the page (previously, it was only in the Environment tab).
    2. The Sitecore size has been split in to Sitecore Configuration and Size drop-downs, the Configuration can be either "Developer" or "Scaled".
    3. When the Configuration selected is “Scaled”, then the Topology Size can be chosen.
  • Marketplace API and SPA v2 
    • Data Structure Improvements
    • SPA Improvements
    • API updates to support Data Structure Improvements

 

 


- Posted on May 24, 10:10 UTC

COMPLETED: 
- Posted on May 27, 16:20 UTC

IN PROGRESS: 

Deployment in progress, No impact expected to existing or new  Sitecore Customer's Cloud resources.


- Posted on May 25, 16:56 UTC

Deployment Started: The deployment on Production has been started.
- Posted on May 24, 10:09 UTC

Identified: 
- Posted on May 24, 00:00 UTC

  May 25, 2018

CES 2.1.1 Release - IP Geo location and Tenant Info services Upgrade

Sitecore prepares an upgrade to the Contact Enrichment Services namely the Geo IP & TenantInformation Services on Azure.

Impact on Customers: No impact on live customer solutions expected.

Release Highlights:

1) Strip IP address captured in application insights to be GDPR compliant.

2) Fix various bugs related to consumption data collection & aggregation.

Bug Fixes included:

1)  Application reported wrongly when aggregating multiple apps from CESConsumption to App center consumption repository.

2)  Strip custom IP address from IP Geo URL in Application Insights

3)  Fix stream analytics query to include fields into rowId

 


- Posted on May 25, 01:00 UTC

COMPLETED: 

Upgrade successfully completed.

All services up & running.


- Posted on May 25, 16:52 UTC

IN PROGRESS: The deployment of the upgrade packages is in progress.
- Posted on May 25, 13:00 UTC

STARTED: Deployment of the upgrade release package for both IP Geo & TenantInfo Azure cloud services has been started.
- Posted on May 25, 10:56 UTC

Identified: 
- Posted on May 25, 00:00 UTC

  May 23, 2018

Managed Cloud Infrastructure Alert


- Posted on May 23, 00:00 UTC

Resolved: 

Issue resolved at 20:30 UTC on 23 May 2018

Issue has been resolved by Microsoft Engineers.

More details: https://azure.microsoft.com/en-us/status/history/


- Posted on May 23, 21:02 UTC

Identified: 

Issue started at 18:20 UTC on 23 May 2018  

A subset of Managed Cloud customers may experience issues when changing infrastructure via Azure Portal. Live solution not affected.

More details: https://azure.microsoft.com/en-us/status/

Sitecore Cloud Engineers will keep monitoring managed cloud services and provide an update once the issue is resolved.


- Posted on May 23, 00:00 UTC

  May 23, 2018

IP Geolocation and Device Detection - Consumption Issues for April-May

There was an inconsistency found in the data consumption aggregation logic on Contact Enrichment Services side. Therefore, while consumption data is still collected, the aggregated view of the consumption data may show incorrect numbers for April and May. Sitecore team is working on the issue analysis and mitigation.

Impact: Consumption data shown in App Center might be incomplete for April, May 2018 and further.

Affected Services: IP Geolocation, Device Detection


- Posted on May 18, 07:00 UTC

ISSUE RESOLVED: The internal Sitecore IP Geolocation and Device Detection configuration issue has now been rectified and we have verified that consumption data is valid and up to date.
- Posted on May 23, 11:37 UTC

Identified: The issue has been identified. Sitecore team is working on the root cause analysis and mitigation. Next updates will posted as soon as possible.
- Posted on May 18, 07:00 UTC

  May 22, 2018

Email Cloud - Web server Planned Maintenance

Sitecore is planning the maintenance activity for the Email Cloud web Server. 

 

Expected impact:During maintenance window ,Email Cloud customers Might not be able to use the Email Cloud Service.


- Posted on May 22, 10:00 UTC

Maintenance Status: 

Planned maintenance activity for the Email Cloud web Server was successfully completed. No issues were identified after the Web Server Maintenance.


- Posted on May 22, 10:50 UTC

Identified: 

Maintenance Window was required for the Email Cloud Web Server Maintenance.


- Posted on May 17, 00:00 UTC

  May 14, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • EXM 3.5.2
  • EXM 3.5.2 Support to Sitecore 8.2.7

- Posted on May 14, 11:00 UTC

Current deployment status: The update has been finished.
- Posted on May 14, 14:55 UTC

  May 11, 2018

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 1.5.0.0 to Sitecore Managed Could Services.

Affected Sitecore Cloud Service: Managed Cloud Core services.

Impact on Customers: No downtime and no impact on live customer solutions expected.

Release summary:   

1. 212399 Refactor Rackspace billing schema and legacy code to remove obsolete tables and code

2. 212411 Add support to Billing for Managed Cloud Premium newest requirements

3. Internal improvements and bugs fixing: 201109, 202067, 202277, 202321, 208396, 209101,211044 

 


- Posted on May 11, 04:30 UTC

Finished: Update has been finished successfully. 
- Posted on May 11, 14:21 UTC

  Apr 28, 2018

Email Cloud - Intermittent Delays

Our underlying SMTP vendor, Sparkpost, has reported an intermittent issue with email deliverability that might caused some delays in dispatching mails via Sitecore EXM and Email Cloud solutions.

More details: https://status.sparkpost.com/incidents/fblwmlc5x9kk


- Posted on Apr 28, 13:30 UTC

Resolved: The issue was active during 1:30 PM - 4:30 PM UTC and now mitigated. No further impact expected.
- Posted on Apr 28, 17:55 UTC

  Apr 26, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • Sitecore 8.2.7
  • WFFM 8.2.7
  • SXA 1.7 (only on SC 8.2.7)

- Posted on Apr 26, 10:30 UTC

COMPLETED: 

The Sitecore Azure Marketplace Core service has been updaded successfully.  


- Posted on Apr 26, 12:44 UTC

Identified: 
- Posted on Apr 05, 14:55 UTC

  Apr 25, 2018

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.313.0, 0.315.0 &  0.316.0 along with some bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore App center SPEAK UI , Sitecore Managed Cloud and Sitecore IP Geolocation offering.

Release Notes:

  • Release 0.313.0: Framework 4.0.1574,Framework.Items 4.0.1574, Framework.Api 4.0.1574
  • Release 0.315.0: ScF.Apps.GeoIP.Items 1.0.281: GeoIP Items which includes GeoIP UI Changes for the unlimited price plan support
  • Release 0.316.0: Sitecore.Apps.ManagedCloud 1.0.358
  • Various updates for improved Sitecore internal applications

Impact on customers during deployment: No impact on live customers expected, but App Center server will be restarted once closer to finish date 

Impact on customers after deployment: After the update is done,

  • The existing customers of the IP Geolocation service will find their plan being updated to “unlimited” with no associated cost. Also the existing customers will neither be able to change their “unlimited” plan nor terminate it. Customers are welcome to contact their regional Sitecore sales representatives to learn more about the change.
  • For any new customer wanting to purchase the Sitecore IP Geolocation service, only 1 option of subscribing to the “12 months unlimited plan” is available with no associated cost.

- Posted on Apr 24, 11:00 UTC

Completed: 

The production SAC servers are now upgraded to the latest handed over release builds and the pertinent smoke tests successfully validated.


- Posted on Apr 25, 12:27 UTC

In Progress: This planned upgrade which involves deployment of the release packages on to the App center servers is in progress.
- Posted on Apr 24, 06:00 UTC

Identified: The upgrade has been started.
- Posted on Apr 05, 14:55 UTC

  Apr 18, 2018

IP Geolocation service upgrade

Sitecore prepares an update to IP Geolocation service with package Release 2.1.0.

Impact on Customers: No impact on live customer solutions expected.

Release summary:

  • 201248 Update MaxMind.GeoIP2 library to 2.9.0
  • 201975 App Insights integration
  • 192048, 202435, 202456, 209426 Improved consumption tracking and reporting
  • 212292 Internal architecture optimization

- Posted on Apr 18, 11:30 UTC

Finished: Update finished. 
- Posted on Apr 18, 17:00 UTC

Identified: 
- Posted on Apr 05, 14:55 UTC

  Apr 05, 2018

Sitecore Status Page - Update 1.2.2

Update Sitecore Cloud - Status Page from v.1.2.1 to v.1.2.2 rev. 180405.

Highlights:

  • Connecting Event notifications with Status Dashboard for consistent status indicators
  • RSS enhancements to support granular updates and filters per service
  • Bug fixes

- Posted on Apr 05, 14:37 UTC

Finished: Update finished.
- Posted on Apr 05, 16:24 UTC

Initiated: Update has been started. No impact on any production Sitecore customer expected.
- Posted on Apr 05, 14:47 UTC

  Mar 30, 2018

Email Cloud - Intermittent Delays

Our underlying SMTP vendor, Sparkpost, has reported an intermittent issue with email deliverability that might caused some delays in dispatching mails via Sitecore EXM and Email Cloud solutions.

More details: https://status.sparkpost.com/incidents/d5q2qnc7c0yq


- Posted on Mar 30, 14:37 UTC

Reviewed: The issue was active during 2PM - 3 PM UTC and now mitigated. No further impact expected.
- Posted on Mar 30, 15:37 UTC

  Mar 27, 2018

Sitecore Email Cloud - messages to Yahoo domain misclassification

In period between March 14-16 an issue was reported by Yahoo. All messages that were sent to yahoo.com domain and bounced with error `554 delivery error: dd This user doesn't have a yahoo.com account ...@... [0] - mta#` should be removed. More details here: https://status.sparkpost.com/incidents/4cdsztdgf2wm

Sitecore is investigating the actual impact on Email Cloud users right now. Update will follow.


- Posted on Mar 14, 00:30 UTC

RESOLVED: Customers, who sent emails to yahoo.com domain between March 14-16 can clean the suppressions table following the steps below:
1. Take a backup of the EXM.Master SQL database or the Suppressions table
2. Run the following script against EXM.Master SQL database :
  DELETE FROM Suppressions
  WHERE 
  SuppressionStatus=0
  AND SuppressTime BETWEEN '2018-03-14 00:00:00' AND '2018-03-16 23:59:59'
  AND Email LIKE '%@yahoo%'
  AND ReasonType LIKE '%554 delivery error: dd This user doesn''t have a yahoo%account%mta#'
  
Please note, if you have been affected by this incident and choose not to clean the suppressions table, you may not be able to send emails to some valid yahoo recipients

- Posted on Mar 27, 10:54 UTC

UPDATE: All false positive suppressions have now been removed from Sparkpost. Sitecore is continuously working on determining the impact on our customers.
- Posted on Mar 23, 14:12 UTC

  Mar 21, 2018

Sitecore Azure Marketplace Outage

Affected Sitecore Cloud Service: Sitecore Azure Marketplace
Number of customers affected:  All Sitecore Customers who needed to provision/deploy/create new Sitecore Experience Cloud instances from Azure Marketplace.
Issue description: 

There was an internal Sitecore Azure marketplace configuration issue that has most probably happened during the recently completed - "Deployment - Sitecore Azure Marketplace Core service upgrade" (refer to https://status.cloud.sitecore.net/maintenance/c7d7036e-1994-464c-ba35-2a5229a33e11). 

Due to this issue, no Sitecore product selection was possible from the Sitecore Azure Marketplace.

Impact on customers: 
All Sitecore Customers who needed to provision/deploy/create new Sitecore Experience Cloud instances from Azure Marketplace could not submit their requests for Sitecore instances deployment through the Sitecore Azure Marketplace.
- Posted on Mar 21, 00:30 UTC

ISSUE RESOLVED: The internal Sitecore Azure marketplace configuration issue has now been rectified and we have verified that  this outage is no more and things are back to normal.
- Posted on Mar 21, 04:30 UTC

ROOT CAUSE IDENTIFIED: 

There was an internal Sitecore Azure marketplace configuration issue that has most probably happened during the recently completed - "Deployment - Sitecore Azure Marketplace Core service upgrade" (refer to https://status.cloud.sitecore.net/maintenance/c7d7036e-1994-464c-ba35-2a5229a33e11). 

Due to this configuration inconsistency on the Azure storage account level, the Sitecore product versions list to be fetched from the storage was not possible.


- Posted on Mar 21, 04:00 UTC

IN PROGRESS: 

Investigation of the Root cause is in progress.

Sitecore team is actively troubleshooting this issue on priority.


- Posted on Mar 21, 03:00 UTC

  Mar 20, 2018

Deployment - Sitecore Azure Marketplace Core service upgrade

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers:

Existing and New customers won't be able to Deploy Sitecore Experience Cloud through Azure Marketplace.

However, existing customers can as usual work with their already deployed Sitecore Cloud resources, no impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • Update EXM 3.5.1 revision to 171103 from 171102(BUG 200479)
  • Fixed EXM DDS Deployment in 9.0.1(BUG 210043)
  • Updated Auto generated Self signed certificates to support Commerce Identity Server
  • Implemented Marketplace specific important notice - To display a message about the “resource group name with underscore makes the marketplace hang”
  • Fixed Duplicate important notice when select the Store Front after selecting the commerce(BUG 207517)
  • Updated API Deployment Arm Templates to set DefaultSasTokenDurationInMinutes to 240

- Posted on Mar 20, 01:00 UTC

COMPLETED: The Sitecore Azure Marketplace Core service has been upgraded successfully. 
- Posted on Mar 20, 16:03 UTC

  Mar 05, 2018

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.309.0, 0.310.0, 0.312.0 along with some bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore Email Cloud, Sitecore Managed Cloud and Sitecore IP Geolocation offering.

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.


- Posted on Feb 28, 06:28 UTC

COMPLETED: 

Production Appcenter has been successfully updated with the latest targetted release packages and the ad hoc hotfixes.

Post deployment validations and smoke tests passed successfully.


- Posted on Mar 05, 08:57 UTC

In Progress: This deployment is in progress.
- Posted on Feb 28, 06:34 UTC

  Feb 26, 2018

Sitecore App center login issue

Issue : Unable to login to the Sitecore App center, because the Sitecore SDN/profile authentication is failing.

Impact on Customers:  Sitecore customers/partners won't be able to access App center since they will be unable to login with their SDN/SPN/Sitecore profile credentials.

Actual impact is that the customers/partners/sitecore account managers won't be able to view the consumption details of IP Geolocation, Sitecore Email Cloud & Sitecore Managed cloud.

Also, purchasing of a new pricing plan / subscribing to a new Sitecore cloud service / changing the existing price plan is affected.


- Posted on Feb 26, 04:00 UTC

Resolved: The issue has been confirmed as resolved after 11:00 AM UTC
- Posted on Feb 26, 17:03 UTC

Identified: 

Unable to login to the Sitecore App center, because the Sitecore SDN/profile authentication is failing.

Sitecore is actively working upon this issue towards resolution.

Updates will be posted as soon as they are available on priority.


- Posted on Feb 26, 07:56 UTC

  Feb 12, 2018

Managed Cloud Core service update

Sitecore prepares an update to Sitecore Managed Cloud Core service with package Release 1.4.3.0.

 

Those changes are focused on internal improvements and optimizations related to Azure consumption statistics. Also, this release finally puts functionality of viewing Managed Cloud Consumption statistics into production accessible for all customers (#191117). Read more here: https://doc.sitecore.net/managed_cloud/sitecore_managed_cloud_overview/view_your_managed_cloud_consumption.

 

Impact on Customers: No impact on live customer solutions expected.


- Posted on Feb 12, 12:10 UTC

Finished: The Managed Cloud core service update has been completed.
- Posted on Feb 12, 14:28 UTC

  Feb 12, 2018

App Center - Planned weekend maintenance for login functionality

Over the weekend, Sitecore will be running maintenance on App Center related infrastructure. This will result in unavailability of App Center UI and its login functionality, so new purchases and reviewing consumption functions won't be available.

All active subscriptions and apps should work without any issues during the maintenance period.


- Posted on Feb 10, 06:00 UTC

Finished: As planned, the maintenance took place during weekend and finished successfully. Event is closed.
- Posted on Feb 12, 08:05 UTC

Scheduled: Maintenance has been scheduled
- Posted on Feb 09, 08:02 UTC

  Jan 30, 2018

Sitecore App Center - Update releases 0.305.0, 0.306.0, 0.307.0, 0.308.0

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.305.0, 0.306.0, 0.307.0, 0.308.0.

Those changes are focused on internal improvements and optimizations related to Sitecore Email Cloud, Sitecore Managed Cloud.

This update also corrects the IP Geo-location consumption reporting (#200108)

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.


- Posted on Jan 29, 10:00 UTC

Completed: 

This App center upgrade/update in the form of deployment of latest release packages has been completed successfully.

Sitecore App center is up & running as usual.


- Posted on Jan 30, 18:43 UTC

In Progress: This App center upgrade/update in the form of deployment of latest release packages has been started & is in progress.
- Posted on Jan 30, 18:41 UTC

  Jan 25, 2018

Managed Cloud Web App Services issue in East US region

Summary of impact: 

Managed Cloud customers from East US may experience intermittent latency, timeouts or HTTP 500-level response codes while performing service management operations such as site create / delete and moving resources on App Service deployments. Autoscaling and loading site metrics may also be impacted.  

Next steps:

Sitecore Operations will monitor the Azure's maintenance and report further updates on Status Page.


- Posted on Jan 24, 08:00 UTC

Resolved: Microsoft Engineers performed a change to the service configuration to optimize traffic which mitigated the issue.
- Posted on Jan 25, 07:50 UTC

  Jan 19, 2018

Deployment - Sitecore Azure Marketplace - Marketplace Upgrades with Sitecore9.0.1, SXA1.6 & WFFM9.0.1 Product Packages

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.  Upgrade will be started soon.

 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Release summary:

1)  Provision for deploying Sitecore 9.0.1

2)  Sitecore Module SXA 1.6

3) Sitecore Module  WFFM9.0.1 

 

Expected impact on customers:

Existing and New customers won't be able to Deploy Sitecore Experience cloud through Azure Marketplace.

However, existing customers can as usual work with their already deployed Sitecore Cloud resources, no impact to existing Sitecore Customer's Cloud resources.

 

Release details:

  • Sitecore 9.0.1
  • SXA 1.6
  • WFFM 9.0.1
  • Module level Important notice support
  • Enable/Disable DDS role installation support
  • Module Dependency Support 

- Posted on Jan 17, 06:00 UTC

COMPLETED: The Sitecore Azure Marketplace has now been upgraded & updated with the latest product packages of this release
- Posted on Jan 19, 10:27 UTC

  Jan 19, 2018

App Center Client Accessing Issue


- Posted on Jan 18, 19:10 UTC

RESOLVED: 

We’ve now rectified this issue on the App center server.

Once we disabled the remaining active license for Email delivery  which was for our internal testing purposes,we are no longer seeing this error anymore from the app center interface once we login.

It has now been verified that the App center interface is loading normally on login without any such errors.


- Posted on Jan 19, 10:19 UTC

Summary of impact: 

There is an issue in accessing the App Center client (Public) portal with error message "There was an Error in the communication with Sitecore App Center server". The Sitecore services (Sitecore Email Cloud, IP Geolocation, Device Detection (for 8.1 - 8.2)) are working with no issues but purchasing and service termination are unavailable until this issue is resolved.

Please reach out to Sitecore Support in case of any questions.

 

Next steps: Sitecore Engineers are currently working on resolving this issue and will update the status page once the issue is resolved.


- Posted on Jan 18, 19:11 UTC

  Jan 17, 2018

Device Detection Database download issue

 

 


- Posted on Jan 05, 13:59 UTC

Resolved: 

Reported issues with Device Detection service were resolved. Customers on Sitecore 9.0 will be able to download the updated Database from Device Detection service.

 


- Posted on Jan 17, 13:08 UTC

Identified: 

Customer running Sitecore 9.0 can face issues with downloading the updated database from Device Detection Service. Sitecore Operation team is reviewing the issue.

 

 


- Posted on Jan 05, 14:03 UTC

  Jan 15, 2018

App Center - Data Center Migration

On 13-Jan-2018, Sitecore will be migrating underlying App Center infrastructure to another data center. This will cause intermittent unavailability of App Center and various cloud services to be unavailable during 13-14 January 2018.

Impact: during maintenance window, it won't be possible to use Sitecore App Center UI, Sitecore Email Cloud, IP Geolocation, Device Detection (for 8.1 - 8.2) services.

Reach out to Sitecore Support in case of any questions.


- Posted on Jan 13, 12:00 UTC

Finished: App Center maintenance finished successfully.
- Posted on Jan 15, 08:23 UTC

Impact Clarified: 

At the time of maintenance progress, impact on Sitecore services is being continuously reviewed.

For now, it's confirmed that IP Geolocation and Email Cloud services are online and not impacted by the maintenance (actual impact was negligible).

Remaining impact: App Center UI is not accessible, Email Cloud consumption data might be unavailable in EXM dashboard, Spam Check and Email Preview.

Sitecore team will continue investigating the ways to minimize the impact on remaining services during the maintenance window and after completion.


- Posted on Jan 13, 21:48 UTC

Started: 

Maintenance started. Planned finish time 20:00 UTC, 14 Jan 2018.

Impact: during maintenance window, it won't be possible to use Sitecore App Center UI, Sitecore Email Cloud, IP Geolocation, Device Detection (for 8.1 - 8.2) services.
Reach out to Sitecore Support in case of any questions.


- Posted on Jan 13, 08:32 UTC

Scheduled: Maintenance has been scheduled
- Posted on Dec 26, 11:35 UTC

  Jan 12, 2018

Deployment - Sparkpost EU Connector service

 

Sitecore Cloud Operations team is preparing a planned update on Sparkpost EU Connector service.  Upgrade will be started soon.

  

No Expected impact on customers:  Update of Sparkpost EU Connector service will not impact any customer. No downtime is expected.

 


- Posted on Jan 11, 08:41 UTC

  Jan 11, 2018

Deployment - Sitecore Azure Marketplace - Marketplace Upgrades with Sitecore9.0.1-SXA1.6 Product Package

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.  Upgrade will be started soon.

 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

 

Release summary:

1)  Provision for deploying Sitecore 9.0.1

2)  Support for SXA 1.6

       

Expected impact on customers:

Existing and New customers won't be able to Deploy Sitecore Experience cloud through Azure Marketplace.

However, existing customers can as usual work with their already deployed Sitecore Cloud resources, no impact to existing Sitecore Customer's Cloud resources

Release details:

              -         Sitecore 9.0.1

-          SXA 1.6

-          Module level Important notice support

-          Enable/Disable DDS role installation support

-          Module Dependency Support


- Posted on Jan 11, 01:00 UTC

CANCELLED: Due to an issue with the Sitecore 9.0.1 release for Azure deployments, this will necessitate a rebuild of platform Web Deploy Packages.
Hence , till we are ready with the updated release packages, this Azure Marketplace Update stays cancelled.
- Posted on Jan 11, 12:40 UTC

  Jan 11, 2018

Managed Cloud And xDB Cloud - VM Maintenance on Azure side

Our Managed Cloud and xDB Cloud vendor, Microsoft Azure will be performing a critical, security-related maintenance-hardware-based security vulnerability (CPU vulnerability) that was identified & disclosed today by Azure.

Various VMs used for delivery of Sitecore xDB Cloud & Managed Cloud services will be rebooted, in order to apply the security fix.

Especially, this may affect Azure VMs under Managed Cloud subscriptions (if any), MongoDB databases availability on xDB Cloud and Managed Cloud xP / xDB sets, xDB Cloud Core services (e.g. REST API).

The maintenance reported start date as of 3:30pm PST on January 3, 2018.

For detailed issue description,  please refer to:

  1. https://azure.microsoft.com/en-us/blog/securing-azure-customers-from-cpu-vulnerability/
  2. https://status.mlab.com/

 


- Posted on Jan 03, 23:30 UTC

Resolved: 

Azure VM Maintenance is now complete & all the Sitecore customer Azure VM's & their Mongo Deployments are now up & running after the patch.


- Posted on Jan 11, 11:16 UTC

Issue resolved: 

VM Maintenance on Azure side is done & all the customer's Azure VM resources & Mongo deployments are now up & running.

 
- Posted on Jan 11, 10:56 UTC

Sitecore Workaround: 

In particular cases, occasional downtime of MongoDB hosted in xDB Cloud / Managed Cloud may lead to Sitecore Content Delivery instances outage or performance degradation.

To learn more about this scenario and about the steps to protect your Sitecore solution from outage, please refer to the following article: https://kb.sitecore.net/articles/930657.


- Posted on Jan 04, 16:09 UTC

Impact Update: As of now, we observe more significant impact on MongoDB servers caused by this maintenance. It leads to longer windows of unavailability (up to 10-20 minutes). We investigate this situation with the vendor to minimize the impact.
- Posted on Jan 04, 12:06 UTC

Identified: 

Azure's Alert has been identified and analyzed from Sitecore perspective. Event entry now posted. Sitecore Operations will monitor the Azure's maintenance and report further updates in this Status Page entry.


- Posted on Jan 04, 09:02 UTC

  Jan 09, 2018

Limited Monitoring Capabilities

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified an issue that limits our monitoring capabilities.

Affected Sitecore Cloud Service: No services affected.

Customers affected: Customers are not affected.

Expected impact on Customers: No impact.

Sitecore Cloud Operations team is working to resolve the issue.


- Posted on Jan 07, 10:15 UTC

Resolved: The internal incident preventing full-featured 24x7 cloud monitoring has been addressed on 08-Jan-2018 after 8:00 PM UTC. All support processes are restored
- Posted on Jan 09, 08:39 UTC

Started: 

The issue was identified.


- Posted on Jan 07, 10:15 UTC

  Jan 05, 2018

Sitecore Cloud services - DNS maintenance

On 05-Jan-2018, Sitecore will perform a maintenance around our underlying Managed DNS provider. This includes *.cloud.sitecore.net and *.sitecore.net domains.

Such domains are used for xDB Cloud 1.0 - 2.0, Email Cloud, App Center and various apps service delivery.

Although no impact on Sitecore customers is expected, Sitecore Cloud Operations will be monitoring the maintenance. Any potential issues will be posted on this page.


- Posted on Jan 05, 01:00 UTC

Finished: Maintenance has completed successfully.
- Posted on Jan 05, 19:53 UTC

Starting: Maintenance expected start is 9:00 PM UTC today. Sitecore Operations team will monitor and report the progress upon completion.
- Posted on Jan 05, 15:03 UTC

Scheduled: Maintenance has been scheduled
- Posted on Dec 26, 09:08 UTC

  Jan 03, 2018

Email Cloud - Intermittent service availability issues due to vendor incident

Underlying Email Cloud vendor, SparkPost, has reported various API errors and latency. Check more details at https://status.sparkpost.com/incidents/t9yg8f380fxv

Impact: Sitecore EXM and Email Cloud customers might have experienced increased latency and intermittent errors on various EXM actions requiring direct connection to Sparkpost API under the hood.

Resolution: This incident has been resolved already by vendor, so no further impact on Sitecore customers.


- Posted on Jan 03, 02:00 UTC

  Dec 29, 2017

Sitecore Managed Cloud - monitoring improvement


- Posted on Dec 29, 09:00 UTC

Finished: Update successfully finished.
- Posted on Dec 29, 16:00 UTC

Started: 

Sitecore team is performing minor updates of customers' resources for monitoring improvements. No impact expected.


- Posted on Dec 29, 09:20 UTC

  Dec 27, 2017

Status Page - Update to v.1.2.1

Update Sitecore Cloud - Status Page from v.1.2 to v.1.2.1 rev. 171227.

Highlights:

  • Labels and coloring adjustment (now, active/resolved events easily recognizable by color)
  • Expandable details in status metrics list 
  • Bug fixes

- Posted on Dec 27, 15:55 UTC

Ready: Update has been seamlessly deployed
- Posted on Dec 27, 16:00 UTC

  Dec 23, 2017

Email Cloud (Sparkpost) - Connector Credentials Service is unavailable

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified that Sparkpost Connector Credentials Service is unavailable (Email Cloud for EXM 3.4+).

Affected Sitecore Cloud Service: Email Cloud (Sparkpost) 

Customers affected: Email Cloud (Sparkpost) Customers

Expected impact on Customers: New session cannot be established and new email dispatch cannot be started.

Sitecore Cloud Operations team is working to resolve the issue.


- Posted on Dec 23, 09:45 UTC

Finished: 

The issue was resolved. Email Cloud (Sparkpost) - Connector Credentials Service is operating normally.


- Posted on Dec 23, 13:00 UTC

Started: 

The issue was identified. Email Cloud (Sparkpost) - Connector Credentials Service is unavailable.


- Posted on Dec 23, 09:45 UTC

  Dec 22, 2017

Sitecore App Center - Update 0.295

Sitecore Cloud Operations prepares an update to Sitecore App Center - Release 0.295.

The changes are intended to introduce new functionality for Managed Cloud Consumption.

 

- Posted on Dec 20, 09:36 UTC

Finished: 

 Sitecore App Center Update was deployed Successfully.


- Posted on Dec 22, 13:16 UTC

Started: 

 Sitecore App Center Update Started.


- Posted on Dec 22, 09:30 UTC

  Dec 21, 2017

Sitecore App Center - Device Detection Update

Retrospective notification to the change introduced with a small App Center configuration update on 11-Dec-2017.

The change leads to inability of purchasing new subscription of Device Detection for Sitecore 8.2 and earlier. Please note that Sitecore 9.0 provides Device Detection service out of the box without App Center subscription.


- Posted on Dec 21, 12:44 UTC

Summary posted: This alert is posted to reflect actual configuration change applied before
- Posted on Dec 21, 12:49 UTC

Change applied: Configuration change has been applied on 11-Dec-2017
- Posted on Dec 11, 12:48 UTC

  Dec 18, 2017

Deployment - Managed Cloud Core Update

Impact: no impact expected.
- Posted on Dec 18, 01:10 UTC

Finished: The update was finished successfully.

- Posted on Dec 18, 13:41 UTC

  Dec 13, 2017

xDB Cloud Core services upgrade

xDB Cloud Core services and xDB Cloud REST API scheduled upgrade. No impact on customers expected.
- Posted on Dec 13, 09:00 UTC

Finished: Upgrade completed successfully.
- Posted on Dec 13, 09:59 UTC

Started: xDB Cloud Core services and xDB Cloud REST API scheduled upgrade started. No impact on customers expected.
- Posted on Dec 13, 09:03 UTC

  Dec 10, 2017

App Center - Planned Hardware Maintenance

On 10-Dec-2017, Sitecore IT will be performing a hardware maintenance. This will cause a downtime on the hosting infrastructure used for SDN.sitecore.net, SPM.sitecore.net, marketplace.sitecore.net, profile.sitecore.net and also some critical internal dependencies of Sitecore App Center.

Impact on Sitecore cloud customers: inability to log in App Center UI. Existing subscriptions and apps (like IP Geolocation etc.) will not be affected.


- Posted on Dec 10, 01:00 UTC

Finished: The maintenance was finished successfully
- Posted on Dec 10, 19:37 UTC

Started: As of 04:00 AM UTC, the maintenance is in progress. As expected, App Center UI login functionality may not work during this time. No impact on other services discovered.
- Posted on Dec 10, 10:41 UTC

Scheduled: The maintenance window has been scheduled for 10-Dec-2017
- Posted on Dec 07, 08:05 UTC

  Dec 01, 2017

Sitecore Email Cloud - Intermittent issues experienced

Starting 17-Nov-2017, 03:00 UTC Email Cloud reported a couple of availability alerts. The service should be working fine now. However, Sitecore team is investigating the root cause of occurred alerts to ensure no further impact on customers.
- Posted on Nov 17, 10:41 UTC

Closure and RCA: After detailed validation, the root cause has been determined within the underlying application code. Sitecore will schedule appropriate fixes in the code for the nearest release. In the meantime, Email Cloud system proves to be stable in the current tier, so system stability is under control now. The event is closed.
- Posted on Dec 01, 12:07 UTC

Analyzed and fixed: 

After investigation, it was confirmed that experienced interim outage appeared due to recent server scale out. The behavior of Email Cloud system with multiple instances appeared less stable. Therefore, the infrastructure has been scaled down on 14:00 UTC to single instance and now system becomes stable.

Summary of the impact: during the issue time frame, customers using EXM with Email Cloud may experience delays on Sitecore start-up or when viewing Email Cloud usage statistics via EXM Dashboard. No impact on email dispatching function has been identified.

Next steps: Sitecore continue dedicated monitoring of the stability after the fix enrollment. We will update the status after healthy status can be permanently confirmed.


- Posted on Nov 17, 15:02 UTC

Identified: Sitecore identified an alert and currently investigate the details of experienced behavior. Further updates will be posted soon.
- Posted on Nov 17, 10:44 UTC

  Nov 26, 2017

App Center - Web server maintenance

On 25.11.2017, 10:00 UTC, Sitecore is planning the maintenance activity for the App Center web server. Please find the details below.

  • Reason: moving to new hardware, increasing the Disk storage space on the Sitecore App Center web server
  • Downtime expected: 10 minutes during the scheduled period
  • Impact on customers: inability to access App Center UI and Email Cloud consumption; inability to use App Center Apps like Spam Check, Email Preview, Email Cloud. Ongoing Email Cloud dispatches should not be affected.

- Posted on Nov 25, 10:00 UTC

Finished: The update has been performed on Saturday, 25-Nov-2017, between 8:00 and 10:00 UTC. All systems returned online just in 5 minutes during this timeframe. No additional issues were determined within further monitoring.
- Posted on Nov 26, 21:33 UTC

Scheduled: The maintenance even has been scheduled
- Posted on Nov 22, 13:22 UTC

  Nov 23, 2017

Sitecore Azure Marketplace - Planned Upgrade

Planned:

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.  Upgrade will be started soon.

 

Expected impact:

No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.


- Posted on Nov 23, 13:09 UTC

Finished: The upgrade was finished successfully.

- Posted on Nov 23, 18:00 UTC

  Nov 19, 2017

Managed Cloud and xDB Cloud - Azure Network Infrastructure issue in North Central US

Starting at 05:40 UTC on 18 Nov 2017 a subset of customers with resources in Azure's North Central US data center may experience connectivity issues as reported by Azure Status Page. Some customers using App Service (Web Apps) may experience latency or timeouts. Sitecore is validating the impact on our cloud infrastructure.


- Posted on Nov 19, 06:00 UTC

Closed: The issue was fixed by Microsoft on November 19th 2017.

- Posted on Nov 19, 14:06 UTC

Update: After deep investigation from Sitecore side, we have found that the issue is not affected our current customers. However, we continue monitoring the state.
- Posted on Nov 19, 10:15 UTC

Identified: The alert has been identified and the investigation process has been started.
- Posted on Nov 19, 09:00 UTC

  Nov 15, 2017

Azure Marketplace and Managed Cloud - New Sitecore provision may not work

Sitecore monitoring identified an error with provisioning of Sitecore Experience Platform (XP) and Experience Manager (XM) instances via standard ARM templates.

The following error may appear in Azure Portal for the target resource group:

"Deployment template validation failed: 'The template resource 'templateLinkBase' at line '27' and column '25' is not valid: The template language function 'replace' expects its first parameter to be of type 'String'. The provided value is of type 'Uri'. Please see https://aka.ms/arm-template-expressions for usage details.. Please see https://aka.ms/arm-template-expressions for usage details.'."

This immediately affects Sitecore provision feature via Azure Marketplace and Sitecore Managed Cloud.

Our team is actively looking for a workaround.


- Posted on Nov 13, 13:48 UTC

Closed: The issue has been fixed by Microsoft on November 15th 2017. We confirm that Provisioning via Azure Marketplace and Azure Toolkit now works as expected.
- Posted on Nov 15, 13:11 UTC

Workaround available: For Azure Toolkit, workaround has been published at https://kb.sitecore.net/articles/143510. This unblocks any Sitecore on Azure and Sitecore Managed Cloud provisioning. Root cause and permanent solution investigation is continuing with Microsoft support. Sitecore Azure Marketplace remains unavailable, Sitecore is looking for the workaround as well.
- Posted on Nov 13, 20:30 UTC

Identified: Issue with Sitecore provision via standard ARM templates has been identified. We are working on the exact impact identification and root cause analysis.
- Posted on Nov 13, 13:51 UTC

  Nov 12, 2017

Managed Cloud and xDB Cloud - Azure SQL databases North Europe and West Europe issues when working via Azure portal

Starting at 04:45 UTC on 11 Nov 2017, Azure has reported an issue that customers using SQL Database in West Europe and North Europe may experience issues managing existing databases via the Azure Management Portal (https://portal.azure.com) and Powershell. During this time, customers may experience higher than normal latency resulting in errors or timeouts ("Gateway timeout”). Azure team is working on the fix.


- Posted on Nov 11, 04:45 UTC

Summary of impact: Between 04:45 and 18:51 UTC on 11 Nov 2017, a subset of customers using SQL Database in North and West Europe may have experienced issues provisioning new databases and managing existing databases via the Azure Management Portal () and Powershell. During this time, customers may have also experienced high latency resulting in errors or timeouts ("Gateway Timeout"). Downstream impact may also have been experienced by HDInsight customers who may have seen deployment failure notifications for the creation of new HDInsight clusters in these regions. This did not affect the availability of existing resources hosted in these regions.
- Posted on Nov 12, 05:05 UTC

Mitigated: MS Azure Engineering discovered a specific check that was causing the regression and isolated this from the production environment. Engineering disabled a specific check that was causing excessive number of requests on the service side. This operation freed capacity and allow service management operations to succeed. 
- Posted on Nov 12, 05:03 UTC

Identified: MS Azure Engineers determined that a regression that was causing increases in traffic between datacenters and consequently an increased latency when performing service management operations on SQL Databases in these regions. These caused some service management operations to timeout.
- Posted on Nov 12, 04:59 UTC

  Nov 10, 2017

Managed Cloud and xDB Cloud - Azure Issue with Redis Cache and VMs

Starting 09:00 UTC, Azure reported an issue with multiple Virtual Machines and Redis Cache instances.

Sitecore monitoring has noted an intermittent impact to xDB Cloud Core services and a few Managed Cloud instances in North/West Europe (Redis Cache).


- Posted on Nov 10, 09:00 UTC

Mitigated: According to Azure status page, the issue has been completely resolved.
Our alerting system no longer reports any outages with Sitecore infrastructure, so issue is mitigated for Sitecore as well.
- Posted on Nov 10, 14:15 UTC

Identified: 

Short downtime (for a few minutes in a period of 09:00-11:00 UTC) has been identified for xDB Cloud Core services affecting xDB Cloud REST API and xDB Cloud 1.0 connectivity.

Redis Cache impact on Sitecore services is being investigated.


- Posted on Nov 10, 11:14 UTC

  Nov 10, 2017

Sitecore App Center - Update releases 0.281,0.283,0.285

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.281,0.283,0.285.

Those changes are focused on internal improvements and optimizations.

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.

 


- Posted on Nov 08, 04:00 UTC

Completed: Deployment completed on the production App center servers. All the smoke tests of post deploy validations have passed successfully.
The Sitecore App center has been successfully upgraded to these release packages.
- Posted on Nov 10, 11:14 UTC

Started: The Production deployment is in progress
- Posted on Nov 09, 13:00 UTC

Scheduled: Upgrade has been scheduled
- Posted on Nov 07, 17:23 UTC

  Nov 09, 2017

Sitecore Email Cloud - Service Issue

Due to on-going issue on Sparkpost Enterprise side (underlying Email Cloud provider), the whole Email Cloud solution may be impacted.

More details on Sparkpost page: https://status.sparkpost.com/incidents/nx70rfdrzt9k

Sitecore is working on clarifying the impact and resolution steps with provider closely.


- Posted on Nov 08, 13:16 UTC

Closed: After further monitoring and final confirmation from the vendor, the alert is close. All Email Cloud systems are functioning as expected.
- Posted on Nov 09, 09:24 UTC

Update: Our provider reports stabilization of the system, so Email Cloud should be stable as well. Internal Sitecore telemetry shows no issues with Email Cloud system, we continue monitoring the state.
- Posted on Nov 08, 15:31 UTC

Identified: The issue has been identified. Currently known impact: intermittent unavailability of Sitecore Email Cloud services (including SMTP/dispatch function). The issue is under investigation.
- Posted on Nov 08, 13:18 UTC

  Nov 06, 2017

xDB Cloud Core service planned upgrade


- Posted on Nov 06, 15:00 UTC

Finished: Upgrade was finished successfully.
- Posted on Nov 06, 15:54 UTC

Planned upgrade: xDB Cloud Core services planned upgrade. No impact on customers expected.
- Posted on Nov 06, 14:00 UTC

  Nov 05, 2017

Status Page - Update to v.1.2

Update Sitecore Cloud - Status Page from v.1.0 to v.1.2 rev. 171105.

Highlights:

  • v.1.1 - Automatic Metrics feature preview: for Email Cloud and for Managed Cloud Core metrics.
    This feature enables automatic update of respective statuses (every 5 minutes), reflecting Sitecore Support monitoring alerts. It's available in preview only for now
  • v.1.2 - RSS feature for Maintenance entries. Single Maintenance Entry page. Enhanced (rich) text format for status maintenance updates available

- Posted on Nov 05, 23:05 UTC

Finished: Update to newer version finished successfully. A few minutes downtime noted for Sitecore Cloud Status Page near 23:30 UTC.
- Posted on Nov 05, 23:54 UTC

Started: Update is scheduled and immediately started. No negative impact on any Sitecore production systems expected.
- Posted on Nov 05, 23:12 UTC

  Nov 02, 2017

Managed Cloud and xDB Cloud 2.0 alert - new environments creation


- Posted on Nov 02, 17:32 UTC

Resolved: Azure storage issue has been resolved by Microsoft engineers. Please refer to the following link for more information https://azure.microsoft.com/en-us/status/history/
- Posted on Nov 02, 18:16 UTC

Identified: 

There's an issue with Azure storage which might cause an error when provisioning new xDB and Managed cloud sets (or Rename, Delete, etc. ) and creating new mlab deployment. Existing customers are not affected.

Microsoft engineers have applied mitigation and are in the final stages of validating that there is no further impact.

Please refer to the following link for more information https://azure.microsoft.com/en-us/status/


- Posted on Nov 02, 17:39 UTC

  Nov 02, 2017

Sitecore App Center - Unavailability due to production webserver down

App center servers are back online & up & running.

App center UI login & management order UI working normally along with the Sitecore Email cloud service.


- Posted on Nov 02, 03:00 UTC

Resolved: 

App center servers are back online & up & running.

App center UI login & management order UI working normally along with the Sitecore Email cloud service.

 

- Posted on Nov 02, 08:28 UTC

Identified: 

App Center endpoint (https://apps.sitecore.net) not reachable, login to App Center UI affected, purchasing unavailable & customer's subscriptions impacted.

Also, other services like Email Preview, Spam Check, Email Cloud (consumption statistics in EXM) are also affected.

Sitecore teams are actively looking & working on this outage to minimize the downtime.


- Posted on Nov 02, 03:00 UTC

  Oct 31, 2017

Sitecore Azure Marketplace - Planned Upgrade

Azure Marketplace data update (product packages fixes for Sitecore 8.2.3 and 9.0.0).


- Posted on Oct 31, 10:00 UTC

Completion: Azure Marketplace data update (product packages fixes for Sitecore 8.2.3 and 9.0.0) completed successfully

 

- Posted on Oct 31, 10:00 UTC

  Oct 26, 2017

xDB Cloud - Intermittent Azure Storage Connectivity - West US

 


- Posted on Oct 26, 16:45 UTC

Issue Resolved: Azure Engineers have ceased this maintenance activity and will perform a full root cause analysis.
- Posted on Oct 26, 20:30 UTC

Cause Confirmed: Azure support identified that a scheduled maintenance activity caused this issue.
- Posted on Oct 26, 19:00 UTC

Unplanned Disruption: As reported by Azure Support (Azure Status History), a subset of xDB Cloud 1.0 and 2.0 customers may experience intermittent difficulties connecting to resources that rely on Azure Storage based in the West US data center.  This disruption can include interruptions to MongoDB resources (mLab Status) that also rely on Azure storage in that data center region.

 

- Posted on Oct 26, 16:45 UTC

  Oct 15, 2017

xDB Cloud and Managed Cloud - Mongo SSL certificates update

On a subset of customers using xDB Cloud 1.0 - 2.0 and Managed Cloud (xP or xDB topologies), MongoDB clusters maintenance will be performed to update SSL certificates. The update will be seamless, but may require a failover, which may lead to couple of seconds of MongoDB unavailability. Sitecore Platform will gracefully handle such small unavailability, so no impact expected.
- Posted on Oct 14, 19:00 UTC

Finished: All the remaining clusters now updated. Maintenance is finished successfully.
- Posted on Oct 15, 21:34 UTC

Continued: First batch of clusters has been upgraded, no issues occurred. However, overall duration of maintenance increased to next day. Upgrade of remaining clusters will be started soon today. The whole maintenance should be finished by the end of today.
- Posted on Oct 15, 15:12 UTC

Started: Maintenance has been started
- Posted on Oct 14, 20:30 UTC

Scheduled: On a subset of customers using xDB Cloud 1.0 - 2.0 and Managed Cloud (xP or xDB topologies), MongoDB clusters maintenance will be performed to update SSL certificates. The update will be seamless, but may require a failover, which may lead to couple of seconds of MongoDB unavailability. Sitecore Platform will gracefully handle such small unavailability, so no impact expected.
- Posted on Oct 14, 08:42 UTC

  Oct 14, 2017

Sitecore App Center - Unavailability due to dependent service error

On 13-Oct-2017 8:00 PM UTC, Cloud Operations team found an issue with one of the underlying service behind Sitecore App Center.

Sitecore App Center functionality is partially unavailable. Work on impact and workaround determination has been started.


- Posted on Oct 13, 21:00 UTC

Resolved: The issue has been resolved at 11:00 AM UTC. All systems returned online.
- Posted on Oct 14, 13:02 UTC

Impact Clarified: 

Confirmed impact as of now: inability to log into App Center UI, inability to view Email Cloud subscription statistics in EXM dashboard.

Dispatching messages via Email Cloud service is not affected and working fine.


- Posted on Oct 14, 08:34 UTC

Identifying: 

After 13-Oct-2017 8:00 PM UTC, Cloud Operations team found an issue with one of the underlying service behind Sitecore App Center.

Sitecore App Center functionality is partially unavailable. Work on impact and workaround determination has been started.


- Posted on Oct 13, 22:10 UTC

  Oct 14, 2017

Sitecore App Center - Update 0.278

Sitecore Cloud Operations prepares an update to Sitecore App Center - Release 0.278.

The changes are intended to address a few login related issues and introduce new functionality for further Sitecore releases.


- Posted on Oct 10, 01:00 UTC

Finished: Upgrade has been finished
- Posted on Oct 14, 05:30 UTC

OnGoing: 

During upgrade, Sitecore App Center and Sitecore Email Cloud services were unavailable for short period of time ( 10 - 15 mins) on 13 Oct 2017 in the 1st half of the day ( UTC).

The issue has been addressed to prevent further failures on that matter.


- Posted on Oct 13, 10:00 UTC

Starting: Upgrade has been started. No impact on any customers expected.
- Posted on Oct 13, 05:03 UTC

Scheduled: Update to Sitecore App Center service is scheduled, Release 0.278 will be rolled out in nearest upgrade window.

The changes are intended to address a few login related issues and introduce new functionality for further Sitecore releases.
- Posted on Oct 10, 10:00 UTC

  Oct 13, 2017

Sitecore Azure Web App deployment issues - Existing clients are not affected

There are issues when deploying Sitecore solution to Azure PaaS environment due to recent change of the Microsoft Azure platform.

Sitecore works closely with Microsoft to find issue's root cause and possible workarounds.

Details: https://kb.sitecore.net/articles/755670

 


- Posted on Sep 19, 21:14 UTC

Issue fixed: Issue with new deployments provisioning is now fixed for xDB Cloud and Managed Cloud services.
- Posted on Oct 13, 11:37 UTC

Permanent fix partially: Permanent fix now applied to Sitecore Azure Toolkit, Managed Cloud and Sitecore provisioning via Azure Marketplace. xDB Cloud 2.0 provisioning stability confirmation is pending.
- Posted on Oct 11, 12:33 UTC

Workaround found: 

The root cause, scope of impact as well as possible workarouds were identified and now available.

Please check KB article for details: https://kb.sitecore.net/articles/755670

Workaround available for: Sitecore deployments via Sitecore Azure Toolkit, Sitecore Managed Cloud

Workaround/fix in progress for: Sitecore Azure Marketplace, xDB Cloud 1.0 - 2.0


- Posted on Sep 22, 08:29 UTC

Investigation in progress: 

Sitecore works closely with Microsoft to find issue's root cause and possible workarounds.

Further updates will be posted here and in the appropriate KB article.


- Posted on Sep 19, 23:00 UTC

Issue Identified: 

We have identified some issues when deploying Sitecore solution to Azure PaaS environment due to recent change of the Microsoft Azure platform.

Details about the error: https://kb.sitecore.net/articles/755670 

Affected services: Sitecore Managed Cloud, xDB Cloud 1.0 - 2.0, Sitecore Azure Marketplace and any Sitecore PaaS deployments via Sitecore Azure Toolkit to Azure Web Apps


- Posted on Sep 19, 21:14 UTC

  Oct 12, 2017

Sitecore Azure Marketplace API & SPA Update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.

The update provides a few new features to support further Sitecore releases. Also, UI has been improved with better retention of values in configuration pages.

Expected impact on customers:   No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.


- Posted on Oct 12, 11:30 UTC

Completed: Sitecore Azure Marketplace infrastructure has been upgraded successfully.
- Posted on Oct 12, 12:51 UTC

Planned: 

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. The update provides a few new features to support further Sitecore releases. Also, UI has been improved with better retention of values in configuration pages. Upgrade will be started soon.

Expected impact: No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch


- Posted on Oct 12, 11:00 UTC

  Oct 10, 2017

Outage for Email Cloud EXM 3.4 +

Issue Identified: We have identified some issues  with our Service Email Cloud EXM 3.4 +. All Customer using Email Cloud EXM 3.4 + are effected.
- Posted on Oct 09, 15:43 UTC

Issue Resolved: In collaboration with Microsoft Azure Support, vendor of connector service, the root cause of issue was identified and resolved.
- Posted on Oct 10, 13:03 UTC

Workaround in progress: Connector app redeployment is now in progress by Sitecore Cloud Operations
- Posted on Oct 10, 05:10 UTC

Cause confirmed: In collaboration with Microsoft Azure Support, vendor of connector service, the root cause of issue was identified in the infrastructure. The workaround being suggested as full app redeployment.
- Posted on Oct 10, 03:05 UTC

Issue Identified: 

Starting ~ 13:00 UTC today, we have identified an issue with our cloud service behind Email Cloud solution for EXM 3.4+. Our team is actively working on identifying potential workaround.

Impact on customers: Sitecore Email Experience Manager (EXM) does not work with Email Cloud.


- Posted on Oct 09, 16:02 UTC

  Oct 10, 2017

IP Geo and Device Detection - Server Code Update


- Posted on Oct 09, 00:30 UTC

Finished:  Code update finished, no significant issues occurred over the course. IP Geolocation and Device Detection are fully functional again. 
- Posted on Oct 10, 10:55 UTC

Scheduled: Planned update to Contact Enrichment Services server code for improving solution stability and prepare for further functionality extension. Affected services: IP Geolocation, Device Detection Impact on customers: GeoIP/Device Detection customers might face brief connectivity issues but no major impact is predicted 
- Posted on Oct 04, 05:33 UTC

  Oct 09, 2017

Deployment - Managed Cloud Core Update

Impact: no impact expected.
- Posted on Oct 09, 11:00 UTC

Finished: Managed Cloud Core services update finished successfully.

- Posted on Oct 09, 13:48 UTC

  Oct 06, 2017

Sitecore xDB Cloud Core services Upgrade

<p> <strong> xDB cloud Llama core services upgraded </strong> </p>

<p>

The deployment on to the production is completed successfully & Llama core services upgraded.

Post deploy validations passed positively.

</p>

 


- Posted on Oct 03, 00:30 UTC

  Oct 04, 2017

Sitecore Azure Marketplace API & SPA Update

<p> Sitecore Cloud Operations team is preparing the following planned release to Sitecore Cloud Services. </p>

<p><strong> Affected Sitecore Cloud Service:  </strong> Sitecore Azure Marketplace API and SPA Endpoints. </p>

<p><strong>  Release summary</strong>   </p>

<p>  Sitecore Azure Marketplace API ver. API 1.0.0 rev. 310  and Marketplace SPA 1.0.0 rev. 361  are the full release product packages. </p>

<p>  This release includes below features, improvements & highlights: </p>

 <br>

  1.  [Bug Fix] Version endpoint returns empty if publishingDate format is wrong
  2.  Adding time zone support for publishingDate (e.g. “19/09/2017 01:30:42 PM +08:00”)
  3.  [Microsoft issue] Update 8.2.x ARM & WDP in Marketplace
  4.  Adding Support for non-string values in metadata
  5.  [Bug Fix] Certificate (upload existing) password validation warning does not disappear upon lose focus
  6.  Added support for non-string values in metadata
  7.  Label/info message changes for certificate generation

<br>

<p><strong>   Expected impact on customers:  </strong>  No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.  </p>


- Posted on Oct 03, 00:30 UTC

Deployment Done: 

<p>Both the  Sitecore Azure Marketplace API & SPA have been upgraded to the latest release packages - API 1.0.0 rev. 310 & SPA 1.0.0 rev. 361 </p>

<p> This completes this deployment successfully </p>


- Posted on Oct 04, 11:37 UTC

  Oct 03, 2017

xDB Cloud - MongoDB updates to 3.0

Following MongoDB 2.6 end-of-life announcement, Sitecore is planning to upgrade all xDB Cloud sets using MongoDB 2.6 to nearest supported version, MongoDB 3.0 MMAPv1. This action helps keeping xDB Cloud environments stable and fully supported.

The MongoDB upgrade scheduled for 30-Sep-2017.

Impact and required actions

Upgrading MongoDB server will not cause any changes, downtime or service degradation for connected Sitecore solution.

Before upgrade is executed, we ask you to ensure one of the following criteria applied to your Sitecore environment:

  1. Sitecore environment runs Sitecore XP 8.0 Update-5 or later. These versions use later Mongo C# driver and fully compatible with MongoDB 3.0
  2. Sitecore environment running Sitecore XP 7.5 Initial Release – 8.0 Update-4 has hotfix 126216 applied on all Sitecore instances. Contact Sitecore Support to request the hotfix
Additional information is available in the Sitecore Knowledge Base: https://kb.sitecore.net/articles/920798
- Posted on Sep 30, 00:30 UTC

Maintenance Status - Completed on Oct 2: Sitecore has completed the upgrade of all xDB Cloud sets using MongoDB 2.6 to nearest supported version, MongoDB 3.0 MMAPv1. There were no reported downtime's and services run smoothly with the new MongoDB driver version.&nbsp;
- Posted on Oct 03, 10:46 UTC

Scheduled: 

Following MongoDB 2.6 end-of-life announcement, Sitecore is planning to upgrade all xDB Cloud sets using MongoDB 2.6 to nearest supported version, MongoDB 3.0 MMAPv1. This action helps keeping xDB Cloud environments stable and fully supported.

The MongoDB upgrade scheduled for 30-Sep-2017. Estimate time frame for migration is couple of days, should be finished till 06-Oct-2017.

Additional information is available in the Sitecore Knowledge Base: https://kb.sitecore.net/articles/920798.


- Posted on Sep 19, 15:30 UTC

  Sep 23, 2017

IP Geo and Device Detection - Server Code Update

Planned update to Contact Enrichment Services server code for improving solution stability and prepare for further functionality extension.

Affected services: IP Geolocation, Device Detection

Impact on customers: GeoIP/Device Detection customers might face brief connectivity issues but no major impact is predicted


- Posted on Sep 23, 06:45 UTC

Finished: Code update finished, no significant issues occurred over the course. IP Geolocation and Device Detection are fully functional again.
- Posted on Sep 23, 10:00 UTC

Started: Code update started.
- Posted on Sep 23, 06:45 UTC

Scheduled: 

Planned update to Contact Enrichment Services server code for improving solution stability and prepare for further functionality extension.

Affected services: IP Geolocation, Device Detection

Impact on customers: GeoIP/Device Detection customers might face brief connectivity issues but no major impact is predicted


- Posted on Sep 23, 04:00 UTC

  Sep 22, 2017

Sitecore Azure Marketplace API & SPA Update

Sitecore Cloud Operations team is preparing the following planned release to Sitecore Cloud Services.

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace API and SPA Endpoints.

Release summary:   

Sitecore Azure Marketplace API ver. API 1.0.0 rev. 297 and Marketplace SPA 1.0.0 rev. 346 are the full release product packages.

This release includes below features, improvements & highlights:

  1.  Added support for uploading and generating certificates for authentication to be used in Sitecore 9.0.0
  2.  Added support for Visibility flag and Publishing Date for any product’s version
  3.  Introduced Web API and Metadata versioning
  4.  Improved SPA’s communication services to better support multiple requests, with different timeout/retry settings using HttpQueues
  5.  Added SKU Size array to support any size naming for products and not only numeric ranges.

Expected impact on customers:   No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.


- Posted on Sep 19, 07:06 UTC

  Sep 22, 2017

xDB Cloud Update - Sitecore 8.2 Update-5 availability

xDB Cloud services planned upgrade scheduled on September 20, 2017. Added support of Sitecore 8.2 Update 5. No impact on existing customers expected.


- Posted on Sep 20, 11:00 UTC

Finished: xDB Cloud services upgrade finished successfully.
- Posted on Sep 22, 13:03 UTC

Update 3: 

xDB Cloud services upgrade is in progress. No impact on existing customers expected.


- Posted on Sep 22, 08:34 UTC

Update 2: Due to technical reasons we decided to postpone deployment till September 22.
No impact on customers.
- Posted on Sep 20, 13:59 UTC

Update 1: 

xDB Cloud services planned upgrade scheduled on September 20, 2017. Added support of Sitecore 8.2 Update 5. No impact on existing customers expected.


- Posted on Sep 20, 13:54 UTC

  Sep 15, 2017

SSL certificate issue with multiple Sitecore Cloud services

SSL Certificate of all Sitecore cloud services expired on 15-Sep-2017. Update of certificate has been performed before the date, however, configuration was not applied properly for multiple resources.

This caused an outage on various Sitecore services such as IP Geolocation, Device Detection, Email Cloud and Sitecore Azure Marketplace.

Customers were not able to connect the services until the certificate is renewed.


- Posted on Sep 15, 18:14 UTC

Issue Resolved: 

Certificates have been updated for all the affected services (Email Cloud, IP Geo Location and Device Detection).

No further impact on any customers expected.


- Posted on Sep 15, 19:33 UTC

Issue resolved for marketplace: Issue has been addressed for Sitecore Azure Marketplace service
- Posted on Sep 15, 16:05 UTC

Issue identified: 

SSL Certificate of all Sitecore cloud services expired on 15-Sep-2017. Update of certificate has been performed before the date, however, configuration was not applied properly for multiple resources. This caused an outage when Sitecore solutions were communicating to those services.

Services affected by outage: IP Geolocation, Device Detection, Email Cloud and Sitecore Azure Marketplace.

Impact: Customers are not able to connect the services until the certificate is renewed.

Next steps: Cloud Ops urgently started configuration update to ensure only new certificate is used


- Posted on Sep 15, 16:00 UTC

  Aug 30, 2017

xDB Cloud core services planned upgrade

xDB Cloud core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Aug 30, 11:00 UTC

Update 2: This upgrade process had been completed now.
- Posted on Aug 30, 18:30 UTC

Update 1: We are starting update xDB Core Production environment. No impact on provisioning function expected.
- Posted on Aug 30, 14:00 UTC

Scheduled: xDB Core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Aug 30, 13:00 UTC

  Aug 24, 2017

Deployment - Managed Cloud Core Update Release 1.3

Sitecore Cloud Operations team is preparing the following planned release to Sitecore Could Services.

Affected Sitecore Cloud Service: Managed Cloud

Release summary: internal enhancements of Managed Cloud registry database (Managed Cloud Core)

Impact on Customers: No downtime and no impact on live customer solutions expected.

Reference Numbers: 149728


- Posted on Aug 23, 16:00 UTC

Deployment Status: Deployment Completed and Tested On Pre-Production and Production
- Posted on Aug 24, 10:13 UTC

  Aug 22, 2017

Managed Cloud - Resources access issue via Azure Portal

azure.microsoft.com was unavailable between 23:59 UTC on 21 Aug 2017 and 00:42 UTC on 22 Aug 2017, so Sitecore Managed Cloud customers might have experienced errors while accessing https://azure.microsoft.com or Azure Portal of respective subscriptions

Full details at https://azure.microsoft.com/en-us/status/history/.


- Posted on Aug 21, 23:30 UTC

Alert: 

azure.microsoft.com was unavailable between 23:59 UTC on 21 Aug 2017 and 00:42 UTC on 22 Aug 2017, so Sitecore Managed Cloud customers might have experienced errors while accessing https://azure.microsoft.com or Azure Portal of respective subscriptions

Full details at https://azure.microsoft.com/en-us/status/history/.


- Posted on Aug 22, 01:00 UTC

  Aug 11, 2017

Marketplace Upgrade - API 1.0.0 rev. 228 and SPA 1.0.0 rev. 282 released


- Posted on Aug 11, 10:00 UTC

Scheduled: Marketplace Core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Aug 11, 10:00 UTC

Update 1: We are starting update Marketplace Production environment. No impact on provisioning function expected.
- Posted on Aug 11, 06:55 UTC

  Aug 04, 2017

Page Preview Service Down

During daily monitoring activities, we have observed & verified that the Page Preview service is down.

This is most likely due to vendor API being down as pointed by internal Sitecore monitoring system. Investigation started in collaboration with vendor (Litmus).


- Posted on May 16, 00:00 UTC

Alert Closed: 

Sitecore decided to officially deprecate and turn off the service.

The service now hidden from App Center UI production, so new activation is no longer possible. 

Existing customer will receive detailed information on further steps shortly over e-mail.


- Posted on Aug 04, 11:26 UTC

Reported: 

During daily monitoring activities, we have observed & verified that the Page Preview service is down.

This is most likely due to vendor API being down as pointed by internal Sitecore monitoring system. Investigation started in collaboration with vendor (Litmus).


- Posted on May 17, 12:36 UTC

  Aug 04, 2017

xDB Cloud 1.0-2.0 - SQL issues impacting xDB Cloud reporting functionality

According to Azure Status report (https://azure.microsoft.com/en-us/status/history), some Azure SQL services in West US region were experiencing intermittent issues with connectivity. The issue occurred between 10:15 UTC on 03 Aug 2017 and 04:15 UTC on 04 Aug 2017.

Potentially affected Sitecore Customers: xDB Cloud 1.0, xDB Cloud 2.0 customers with sets in West US region

Potential Impact: customers may not be able to view reports or reports may appear slower than usual. Customer’s content delivery was not affected at all.

 


- Posted on Aug 03, 22:00 UTC

Alert: 

According to Azure Status report (https://azure.microsoft.com/en-us/status/history), some Azure SQL services in West US region were experiencing intermittent issues with connectivity. The issue occurred between 10:15 UTC on 03 Aug 2017 and 04:15 UTC on 04 Aug 2017.

Potentially affected Sitecore Customers: xDB Cloud 1.0, xDB Cloud 2.0, Managed Cloud customers with sets in West US region

Potential Impact: customers may not be able to view reports or reports may appear slower than usual. Customer’s content delivery was not affected at all.

Mitigation: Microsoft Azure engineers have resolved the issue on 04 Aug 2017, 04:15 UTC.


- Posted on Aug 04, 10:00 UTC

  Aug 03, 2017

App Center Update - Release 0.266 and 0.271

Sitecore Cloud Operations prepares the following update to production Sitecore Service Offering:

Start Date:  24-Jul-2017, 04:00 UTC

Planned Finish Date: 31-Jul-2017, 11:00 UTC

Update Description: Bug fixes for the new SPEAK UI in Sitecore 9.0 and for the Management portal (Orders.aspx)

Impact on Customers:  No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.

Release Notes:

Version Info: Release 0.266.0 (Framework) and Release 0.271.0 (Management).

  • App Center UI for Sitecore 9.0 (SPEAK) fixes
  • Bug 149442: Orders.aspx not loading correct lines

- Posted on Jul 24, 11:00 UTC

Completed: The Sitecore App center has been successfully updated with the release packages - 0.271 & 0.272 which include the Bug fixes for the new SPEAK UI in Sitecore 9.0 and for the Management portal (Orders.aspx) 
- Posted on Aug 03, 05:37 UTC

Maintenance Status:  Bug fixes for the new SPEAK UI in Sitecore 9.0 and for the Management portal (Orders.aspx)
- Posted on Aug 03, 05:34 UTC

  Jul 25, 2017

xDB Cloud core services planned upgrade


- Posted on Jul 25, 10:00 UTC

Completed: Core services upgrade completed
- Posted on Jul 25, 11:48 UTC

Scheduled: xDB Cloud core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Jul 25, 09:07 UTC

  Jul 18, 2017

App Center Update

App Center has been updated with a security hotfix, details are described in KB article https://kb.sitecore.net/articles/978654
- Posted on Jul 18, 09:08 UTC

  Jul 10, 2017

xDB Cloud Customers Update

As part of stability improvements to cloud platform, we are delivering a codebase update to all Sitecore xDB Cloud users within the next week: 06-11 July 2017

The recent hotfix from Security Bulletin SC2017-001-170504 has been included in the codebase update.


- Posted on Jul 06, 10:00 UTC

Update 5: All customers on Sitecore version 8.2 were updated successfully.
- Posted on Jul 10, 15:09 UTC

Update 4: All customers on Sitecore version 8.1 Update 3 were updated successfully.
- Posted on Jul 07, 14:08 UTC

Update 3: All customers on Sitecore version 8.1 Update 2 were updated successfully.
- Posted on Jul 07, 09:44 UTC

Update 2: All customers on Sitecore version 8.1 Update 1 were updated successfully.
- Posted on Jul 06, 16:59 UTC

Update 1: All customers on Sitecore version 7.5 and 8.5 were updated successfully.
- Posted on Jul 06, 09:07 UTC

Scheduled: 

As part of stability improvements to cloud platform, we are delivering a codebase update to all Sitecore xDB Cloud users within the next week: 06-11 July 2017

The recent hotfix from Security Bulletin SC2017-001-170504 has been included in the codebase update.


- Posted on Jul 05, 10:00 UTC

  Jun 27, 2017

Email Delivery Alert triggered


- Posted on Jun 27, 20:11 UTC

Restored: Investigation complete, no effect on Sitecore Email Delivery service found.
- Posted on Jun 27, 22:00 UTC

Identified: Internal Sitecore monitoring system identified an alert with Email Delivery for EXM 1.0 - 3.3 (Dyn) service. The timing of incident correlated with Dyn report on DNS API degradation, while this service does not directly affects EXM functionality. Investigation started
- Posted on Jun 27, 20:11 UTC

  Jun 21, 2017

Email Cloud - Intermittent unavailability (planned)

On 21 June, Sitecore Email Cloud delivery provider (Sparkpost) will be executing maintenance.

This maintenance may cause intermittent REST API availability, which may affect certain operations for Sitecore Email Experience (3.4 +) customers using Email Cloud service.

Email dispatching will not be affected.


- Posted on Jun 21, 19:00 UTC

Completed: 

Provider reports successful maintenance completion. Feel free to contact Sitecore Support (https://support.sitecore.net) in case of any issues noted.


- Posted on Jun 21, 21:20 UTC

Back to schedule Started: 

As reported by our email provider, the maintenance is now set to begin on 21-Jun-2017 at 7pm UTC time. This will not cause immediate service degradation, but API calls failures may occur. As planned, email delivery is not affected in any way.


- Posted on Jun 21, 19:00 UTC

Postponed: 

Maintenance postponed until 23 June 2017. Further updates will be posted closer to maintenance date.


- Posted on Jun 20, 07:05 UTC

Scheduled: 

On 19 June, Sitecore Email Cloud delivery provider (Sparkpost) will be executing maintenance.

This maintenance may cause intermittent REST API availability, which may affect certain operations for Sitecore Email Experience (3.4 +) customers using Email Cloud service.

Email dispatching will not be affected.


- Posted on Jun 17, 09:18 UTC

  Jun 20, 2017

Email Delivery for EXM 1.0 - 3.3 service degradation

Due to API Degradation reported by Dyn, underlying email vendor of Sitecore Email Delivery for EXM 1.0 - 3.3 service, some features of EXM 1.0 - 3.3 using Sitecore MTA might not be available. Email dispatching is not affected by this issue.

More details on Dyn Status Page: https://www.dynstatus.com/incidents/1zb4n5qxvn51


- Posted on Jun 18, 11:40 UTC

Restored: 

According to the vendor, Email API is restored, so all systems related to Email Delivery for EXM 1.0 - 3.3 are functioning again.


- Posted on Jun 20, 07:02 UTC

Identified: 

Due to API Degradation reported by Dyn, underlying email vendor of Sitecore Email Delivery for EXM 1.0 - 3.3 service, some features of EXM 1.0 - 3.3 using Sitecore MTA might not be available. Email dispatching is not affected by this issue.

More details on Dyn Status Page: https://www.dynstatus.com/incidents/1zb4n5qxvn51


- Posted on Jun 18, 13:53 UTC

  Jun 04, 2017

App Center Maintenance

App Center will be down for regular maintenance.


- Posted on Jun 04, 07:00 UTC

App Center Maintenance Completed: 

App Center Maintenance was finished. All Services are working as expected.

Delivered changes: Email Preview and Spam Check apps are no longer available for purchase via App Center (regional office should be contacted from now on), also some background fixes in the system.


- Posted on Jun 04, 07:56 UTC

  May 23, 2017

App Center with Multiple Services were temporarily down

During daily monitoring activities, we have observed & verified that following services were down :

 

Page Preview service – Litmus

Spam Check – Litmus

Email Preview – Litmus

CRM connections 


- Posted on May 23, 01:00 UTC

Closure Root Cause Analysis: 

Upon investigation, it was found that hard disk to the server hosting App Center VM had crashed. After contacting infrastructure team, we found that the VM didn’t start properly after hard disk replacement. A proper reboot solved the Issue. The Services are back to normal except Page Preview (see active maintenance for status).


- Posted on May 23, 10:15 UTC

Identified and resolved: 

During daily monitoring activities, we have observed & verified that following services were down:

    • Page Preview
    • Spam Check
    • Email Preview
    • Email Delivery for EXM 1.0 – 3.3 
    • App Center UI 

Customer Impact 

App Center users not able to use App Center and face errors upon accessing. Thus not being able to access all the above services as well.

Details

All of the services listed above were down from 01:00 AM – 04:55 AM UTC. The incident was fixed upon determination with help of infrastructure team. Root cause analysis is on-going, results will be posted later


- Posted on May 23, 10:14 UTC

  May 12, 2017

IP Geolocation - Inability to view consumption data

Customers are not able to see IP Geolocation consumption data for May 2017


- Posted on May 11, 00:00 UTC

Restored: 

Consumption data reports restored for IP Geolocation service, no further issues. Sitecore is monitoring the system state after fix application. Also, an additional level of monitoring will be implemented for faster service restoring in future.


- Posted on May 12, 12:27 UTC

Identified: 

Sitecore Cloud Operations team have identified an issue with the following details:

Sitecore Cloud Service: Sitecore IP Geolocation

Impact: All service customers are not able to view IP Geolocation consumption data for May 2017 in Sitecore App Center

Status & Next-Steps: Sitecore team is actively working on restoring the consumption view feature. Next update will be provided within this thread on issue resolution.


- Posted on May 11, 12:52 UTC

  May 04, 2017

App center DB server Issue : unable to remote login to App center Database server

During daily monitoring activities Sitecore Cloud Operations team have identified an issue with one of the App Center server.

 

Customer Impact :          Short/very few minutes downtime expected for all customers

 

Details:

 

              Today we have identified that the remote login to the App center Database server has been failing.

               As of now, All App center operations are working fine & customer endpoints working normal, only the backend login to the server is not possible for now.

              We believe some processes on the server might be stalled for which the server restart would be needed.

              We are working with the IT team to resolve this issue. 

The Database server will be restarted by the Sitecore IT team now.

The App center will have a downtime of appx. 5 - 10 minutes for all customers


- Posted on May 04, 09:20 UTC

Login to App center Database server now possible: 

This maintenence is now completed after the DB server was restarted.

All app center services are up & running & we have smoke tested the customer facing apps to be positive.

The downtime was approximately 5 minues.


- Posted on May 04, 09:20 UTC

  Apr 12, 2017

App Center Login issue

All Sitecore customers when trying to log into App Center UI will see an error.

All purchased App Center services are running well.


- Posted on Apr 12, 12:00 UTC

Restored: 

Service is restored, login functionality works again.

Team is working on root cause analysis now.


- Posted on Apr 12, 12:59 UTC

Identified: 

On 12-Apr-2017, 10:00 UTC issue with login functionality has occurred.

Impact:

All Sitecore customers when trying to log into App Center UI will see an error.
All purchased App Center services are running well.

Our team will continuously work to investigate the issue and find a workaround.


- Posted on Apr 12, 12:37 UTC

  Apr 11, 2017

xDB Cloud - Planned Service Maintenance

482298 - [Deployment] OT Migration - updated changes with support of moving Search and SqlDB is ready for deployment


- Posted on Apr 11, 14:40 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Apr 11, 12:45 UTC

IN PROGRESS: 

xDB Cloud Сore services planned upgrade


- Posted on Apr 11, 11:42 UTC

  Apr 04, 2017

App Center Shop is temporary unavailable

App Center Shop is temporary unavailable.

After restart of CRM, service is back online.


- Posted on Apr 04, 08:00 UTC

RESOLVED: 

App Center UI access is now working fine, issue resolved.


- Posted on Apr 04, 08:57 UTC

IN PROGRESS: 

App Center UI is temporary unavailable due to underlying internal service went down. Customers are not able to make new purchases in the meantime. Sitecore team is working on restoring the service.

All purchased applications are running normal


- Posted on Apr 04, 08:28 UTC

  Mar 17, 2017

xDB Cloud - Planned Service Maintenance

Core services upgrade - Cloud[#481335]


- Posted on Mar 17, 16:00 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Mar 17, 16:19 UTC

IN PROGRESS: 

xDB Cloud Сore services planned upgrade


- Posted on Mar 17, 15:12 UTC

  Mar 17, 2017

App Center Maintenance

App Center will be down for regular Maintenance. 


- Posted on Mar 24, 11:00 UTC

App Center down for Maintenance: 

App Center will be down for the next 10 min.


- Posted on Mar 17, 10:33 UTC

App Center up and running: 

Regular Maintenance was performed on the App Center. Down Time was next 10 min.


- Posted on Mar 17, 10:23 UTC

  Mar 06, 2017

xDB Cloud - Planned Service Maintenance

xDB Cloud Сore services planned upgrade


- Posted on Mar 06, 18:00 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Mar 06, 18:21 UTC

SCHEDULED: 

xDB Cloud Сore services planned upgrade


- Posted on Mar 06, 15:52 UTC

  Mar 03, 2017

App Center Facing TimeOut Issue

Issues been discovered in the morning 03-Mar-2017 with CRM auxiliary used by App Center which can cause customers facing time out issue while logging in to App Center. Operations Team is working to back system on track.


- Posted on Mar 03, 04:00 UTC

UI TimeOut Issue resolved: 

Issue were  discovered with CRM auxiliary service used by App Center. Consecutively App Center Web Interface was non responsive. All service (Email Delivery etc.) were working as usual. The Issue was Identfied and was resolved.


- Posted on Mar 03, 11:16 UTC

ISSUE DISCOVERED AND IN PROGRESS: 

Issue has been discovered in the morning 03-Mar-2017 with CRM auxiliary service used by App Center which can cause customers facing time out issue while logging in to App Center. Operations Team is working to get back system on track.


- Posted on Mar 03, 07:35 UTC

  Mar 01, 2017

xDB Cloud - Planned Service Maintenance

SCHEDULED

xDB Cloud Сore services planned upgrade to deliver support for Sitecore 8.2 Update 1 and SItecore 8.2 Update 2.

Impact on existing customers: no impact


- Posted on Mar 01, 17:00 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Mar 01, 16:06 UTC

SCHEDULED: 

xDB Cloud Сore services planned upgrade to deliver support of Sitecore 8.2 Update 1 and SItecore 8.2 Update 2.

Impact on existing customers: no impact


- Posted on Mar 01, 15:40 UTC

  Feb 23, 2017

App Center Maintenance

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) on23-Feb-2017 Impact: no impact expected


- Posted on Feb 23, 09:00 UTC

FINISHED: 

Maintenance completed successfully.


- Posted on Feb 23, 19:56 UTC

Initialization: 

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) on 23-Feb-2017 .Impact: no impact expected.


- Posted on Feb 23, 19:53 UTC

  Feb 21, 2017

xDB Cloud 1.0 outage in Australia

Outage has been discovered in the late 20-Feb-2017. Only xDB Cloud 1.0 customers in Australia Southeast are affected. Ops team works on solution.


- Posted on Feb 21, 00:00 UTC

Issues Resolved: 

Solution applied resolved the issue completely (confirmed).


- Posted on Feb 21, 13:17 UTC

Solution Applied: 

All Australia xDB Cloud 1.0 sets are reachable now. Ops team monitors the health now


- Posted on Feb 21, 08:22 UTC

Issue Discovered and In Progress: 

Outage has been discovered in the late 20-Feb-2017. Only xDB Cloud 1.0 customers in Australia Southeast are affected. Ops team works on temporary workaround and root cause.


- Posted on Feb 21, 07:28 UTC

  Feb 07, 2017

Continuous App Center Maintenance

After recent App Center Update, Sitecore App Center sometimes fail to log in. Operations Team is working to back system on track.


- Posted on Jan 10, 00:00 UTC

Resolved: 

This Issue of inability to login to App center has now been fixed.  A new fix to remediate this issue has been deployed on the App center.

It's been verified since then that the authentication to the App center works fine & no downtime caused for the end users/customers login to the App center.


- Posted on Feb 07, 05:05 UTC

Interim Workaround: 

There is an interim workaround available to fix any App Center login issue. Reach out to Sitecore Support (https://support.sitecore.net) with reference ID 143243 to request workaround applied.

Work on permanent fix is continued.


- Posted on Jan 17, 15:41 UTC

In Progress: 

After recent App Center Update (finished 10-Jan-2017), Sitecore App Center sometimes fail to authenticate users. Therefore, some customers may not be able to log into App Center.

Impact: interim inability to log into App Center. All service (Email Delivery etc.) are working as usual.

Actions: Operations Team is working to back system on track.


- Posted on Jan 14, 13:07 UTC

  Jan 10, 2017

App Center Maintenance

During the weekend, Sitecore Cloud Operations will be updating App Center codebase.

No impact on production users expected, but we encourage customers not to perform any App Center actions during the period of maintenance.


- Posted on Jan 07, 00:00 UTC

Finished: 

App Center Update has been finished on 10-Jan-2017, 16:00 UTC. All App Center features work properly.


- Posted on Jan 10, 20:27 UTC

Maintenance Continued: 

App Center maintenance took more time than expected. Activities will be continued during 10-Jan-2017. Current expectations to finish maintenance: 11-Jan-2017.

Notes: new customers may not have the ability to access App Center until maintenance end.


- Posted on Jan 09, 20:08 UTC

Temporary Login Issues: 

During 08-Jan-2017, starting 07:30 AM UTC App Center reported an issue with the ability for Sitecore customers to log into App Center UI. This has been fixed at 11:30 AM. Maintenance continued.


- Posted on Jan 08, 11:37 UTC

Scheduled: 

During the weekend, 07-Jan to 09-Jan, Sitecore Cloud Operations will be updating App Center codebase.

No impact on production users expected, but we encourage customers not to perform any App Center actions during the period of maintenance.


- Posted on Jan 06, 08:18 UTC

  Jan 04, 2017

xDB Cloud - Planned Service Maintenance

SCHEDULED

xDB Cloud Discovery and related core services DNS maintenance.

Impact on existing customers: no impact


- Posted on Jan 04, 14:30 UTC

FINISHED: 

Maintenance completed successfully.


- Posted on Jan 04, 16:13 UTC

SCHEDULED: 

xDB Cloud Discovery and related core services DNS maintenance.

Impact on existing customers: no impact


- Posted on Jan 04, 14:24 UTC

  Dec 24, 2016

xDB Cloud - Planned Service Update

Introducing support of 8.2 Initial release for xDB Cloud 2.0 service. New customers will be able to request xDB Cloud 2.0 set for Sitecore 8.2 Initial Release.

Impact on existing customers: no impact


- Posted on Dec 22, 00:00 UTC

Finished: 

Codebase updated, Sitecore 8.2 is now available to provision on new xDB Cloud 2.0 sets.


- Posted on Dec 24, 22:52 UTC

Scheduled: 

Core service update scheduled for deploying new service features.

Impact on existing customers: no impact


- Posted on Dec 21, 23:21 UTC

  Dec 16, 2016

App Center Maintenance

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) during 05-Dec-2016 - 08-Dec-2016 timeframe.

Impact: no impact expected.


- Posted on Dec 05, 00:00 UTC

Done: 

All deployment activities finished


- Posted on Dec 16, 14:15 UTC

Still in progress Delayed: 

App Center switch was postponed, so anticipated production switch will occur 13-14 December. No impact on customers expected.


- Posted on Dec 13, 08:01 UTC

Initialization: 

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) during 05-Dec-2016 - 08-Dec-2016 timeframe.

Impact: no impact expected.


- Posted on Dec 01, 13:29 UTC

  Dec 13, 2016

xDB Cloud - Updating Processing and Reporting services

For all xDB Cloud customer, Sitecore Cloud Operations team is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

No downtime and no impact expected.


- Posted on Dec 08, 00:00 UTC

Done: 

Maintenance finished. No issues occurred.


- Posted on Dec 13, 15:12 UTC

In Progress: 

For xDB Cloud customers, Sitecore Cloud Operations is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

No downtime and no impact on live Sitecore solutions expected.


- Posted on Dec 08, 08:07 UTC

  Dec 02, 2016

xDB Cloud 1.0 Discovery Service incident

Cloud Operations identified an issue with interim unresponsiveness of Discovery Service in Europe


- Posted on Dec 01, 00:00 UTC

Resolved: 

RCA completed and further action for improving stability were taken.

System is fully restored.


- Posted on Dec 02, 10:04 UTC

Incident Fixed: 

Cloud Operations team took broken node out of production, so Discovery service is fully functional now. Root cause analysis in progress


- Posted on Dec 01, 15:55 UTC

Issue Identified: 

During daily monitoring activates of xDB Cloud service, following issue with xDB Cloud was identified:

Issue Description: One of the nodes behind discovery service was in unresponsive state, causing some of requests to https://discovery-xdb-cloud.sitecore.net to fail

Customers affected: potentially, all xDB Cloud 1.0 customers (mostly, European xDB Cloud 1.0 customers) who re-connected to xDB Cloud during issue time frame

Time frame: 01-Dec-2016 07:00 AM UTC – 01-Dec-2016 1:00 PM UTC

Possible Impact on customer’s solution: when starting Sitecore solution connected to xDB Cloud 1.0, solution may fail to connect xDB Cloud and get connection strings


- Posted on Dec 01, 15:55 UTC

  Nov 29, 2016

xDB Cloud - Core Maintenance

General maintenance on xDB Cloud Core Services for stability improvement.

No impact on xDB Cloud customer sets. More details on dev.sitecore.net.


- Posted on Nov 28, 00:00 UTC

Updated: 

General maintenance on xDB Cloud Core Services for stability improvement.

No impact on xDB Cloud customer sets. More details on dev.sitecore.net.


- Posted on Nov 29, 21:43 UTC

  Oct 23, 2016

Interim issue accessing Sitecore Cloud services due to DNS

Issue due to DDoS attack on our DNS provider, DynDNS:

https://www.dynstatus.com/incidents/5r9mppc1kb77


- Posted on Oct 21, 10:00 UTC

Summary: 

On 21-Oct-2016, our DNS service provider reported an issue of temporary DNS unavailability. More details available on provider page.

Impact: during daily monitoring, Sitecore's Cloud Operations indicated a very few instances of unavailability of our services like xDB Cloud Discovery Service (used in xDB Cloud 1.0) and App Center services for short period of times during 21-Oct.

Resolution: all systems fully available and stable since 22-Oct.


- Posted on Oct 23, 18:16 UTC

  Oct 21, 2016

App Center Update

Over the week, Sitecore Cloud Operations is working on production update of Sitecore App Center.

Impact: possible interriment impact on App Center UI operations


- Posted on Oct 17, 00:00 UTC

Maintenance Finished: 

App Center resources have been successfully updated.


- Posted on Oct 21, 08:19 UTC

Maintenance Started: 

Over the week, Sitecore Cloud Operations is working on production update of Sitecore App Center.

Impact: possible intermittent impact on App Center UI operations


- Posted on Oct 17, 12:37 UTC

  Oct 20, 2016

xDB Cloud - Updating Processing and Reporting services

For various xDB Cloud customer, Sitecore Cloud Oeprations team is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

  • Expected downtime: no downtime
  • Possible impact on Sitecore site connected to xDB Cloud: temporary delay (few minutes) with showing up new data in reports is possible

- Posted on Oct 12, 00:00 UTC

Maintenance Finished: 

All update procedures are finished, no issues occurred during maintenance period.


- Posted on Oct 20, 17:35 UTC

Maintenance In Progress: 

For xDB Cloud customers, Sitecore Cloud Operations team is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

Impact on Sitecore sites connected to xDB Cloud: no downtime for data collection, temporary delay (a few minutes) for the collected data to show up in reports


- Posted on Oct 12, 06:51 UTC

  Oct 15, 2016

Email Delivery - Intermittent error with purchasing new Email Delivery subscription in App Center

On 11-Oct-2016, Sitecore identified an issue with App Center being unable to process Email Delivery purchases properly.

Any Email Delivery purchase posted starting from 11-Oct-2016 might be affected.


- Posted on Oct 11, 00:00 UTC

Issue resolved: 

On 13-Oct-2016, issue's root cause has been addressed. The error with Email Delivery activation is fixed.


- Posted on Oct 15, 08:10 UTC

Issue Identified: 

On 11-Oct-2016, Sitecore identified an issue with App Center being unable to process Email Delivery purchases properly.

Any Email Delivery purchase posted starting from 11-Oct-2016 might be affected


- Posted on Oct 13, 08:26 UTC

  Oct 12, 2016

App Center Maintenance

Cloud Operations team will perform Maintenance on the Production App Center servers.


- Posted on Sep 20, 21:00 UTC

Done: 

App Center maintenance was finished successfully


- Posted on Oct 12, 06:55 UTC

  May 14, 2016

Dyn Email Delivery Degraded Performance

Our engineers have implemented further network and code improvements, reducing the number of HTTP 500, 502, and 504 responses from both Send API and reporting requests. Additional measures are being worked on and customers should continue to see a decrease in responses as a result. If you are continuing to see HTTP error responses, or timeouts in general, please reach out to our Technical Support Team.

 

http://www.google.com


- Posted on May 14, 09:00 UTC

  May 11, 2016

China Network Latency

customers using our China Network nameservers began to experience issues with latency. Our engineers are aware of the issue. Our transit provider is working on a resolution. We will post updates as they become available. We do not recommend that customers make any changes in their configuration in response to this event. This only affects our mainland China Network nameservers, not our global Anycast network


- Posted on May 11, 09:00 UTC