Sitecore Cloud - Status Page Last updated 3 minutes ago
Active Events

  Dec 09, 2019

Sitecore provisioning is not working due to Azure SQL issue

Estimated time frame: Dec 09, 12:04 - Dec 10, 00:00 UTC

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified an event which we would like to bring to your attention. In case you have any follow up question regarding the event, please do not hesitate to raise a support case on that matter from the home page of Sitecore Support & Self-Service Portal.

 

Event description: During daily activities, Sitecore engineers detected the issue with Sitecore provisioning related to the issue with Azure SQL database version which is not compatible with our deploy packages

Impact: Sitecore provisioning is not working as expected. No impact on the existing Sitecore Customers’ Cloud resources.

Planned further actions: Sitecore Cloud engineers are working closely with the Azure support team to get this resolved.

Who performs further actions: Sitecore Cloud Operations

 

 


- Posted on Dec 09, 12:04 UTC

In progress: Sitecore Engineers are working with Microsoft to get this resolved . More updates will be posted soon.  
- Posted on Dec 09, 12:33 UTC

Identified: The issue has been identified.
- Posted on Dec 09, 12:04 UTC

Scheduled Events

  Dec 10, 2019

Azure Marketplace Deployment

Estimated time frame: Dec 10, 07:00 - Dec 10, 10:00 UTC

Sitecore Cloud Operations team is preparing a planned deployment on the Azure Marketplace infrastructure with fixes for the current marketplace deployment issues. 

Affected Sitecore Cloud Service:   Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Fix Content Delivery Network module's deployment issue when using existing CDN's endpoint.

 


- Posted on Dec 10, 07:00 UTC

Identified: This deployment has been scheduled for December 10, 07:00 UTC
- Posted on Dec 06, 00:00 UTC

All Past Events

  Nov 27, 2019

Sitecore Azure Marketplace Deployment

Sitecore Cloud Operations team is preparing a planned deployment on the Azure Marketplace infrastructure with new Sitecore & Sitecore Modules releases.

Affected Sitecore Cloud Service:   Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

             Sitecore 9.3 Initial Release

             Azure Blob Storage 1.0 Initial Release

             Sitecore JavaScript Services Server 13.0 Initial Release

             Sitecore Experience Accelerator 9.3 Initial Release

             Content Delivery Network (CDN) 1.0 Initial Release Support for Sitecore 9.3

 


- Posted on Nov 26, 11:00 UTC

COMPLETED: The production deployment has been successfully completed and all the post deployment verification procedures have been successfully completed.
- Posted on Nov 27, 19:53 UTC

IN PROGRESS: The production deployment has been started & is currently in progress.
- Posted on Nov 27, 05:47 UTC

STARTED: The upgrade of the Azure Marketplace on production has been started.
- Posted on Nov 26, 11:14 UTC

  Nov 20, 2019

Managed Cloud provisioning restricted in West US and East US 2

Due to high demand for Azure SQL DB's in these regions , we are facing issues with quota limitation while deploying Managed cloud environments. 

We are constantly working with Microsoft to get this issue resolved as soon as possible. 

 

 


- Posted on Nov 19, 00:00 UTC

Resolved: 

We have investigated the issue with Microsoft .  As per our investigation , below are our key findings - 

  1. In some Regions, the demand for a specific Azure resource may outstrip capacity, and while Microsoft is actively working to build out additional capacity, sometimes Microsoft have to make the difficult decision to restrict new subscriptions in a few Regions.
  2.  In case , if our customers face this issue , the suitable action is to raise a support request to Microsoft  after which the region will be enabled/whitelisted on demand .

- Posted on Nov 20, 08:22 UTC

In Progress: The issue has been resolved for the East US 2 region . However , you may still face issue while deploying Managed Cloud Sitecore environments or SQL server in West US region .
- Posted on Nov 20, 05:42 UTC

In-Progress: Sitecore Engineers are working with Microsoft to get this resolved . More updates will be posted soon.  
- Posted on Nov 19, 02:21 UTC

Identified: Sitecore Engineers have identified this issue and working with Microsoft to get this resolved. 
- Posted on Nov 19, 00:00 UTC

  Nov 15, 2019

CES Release 3.0.0 for ServiceNow GeoIP Service

Sitecore Cloud Operations team is preparing the following planned release to Sitecore Cloud Services.

Affected Sitecore Cloud Service:   Contact Enrichment Services namely the IP Geo-location & TenantInformation Services.

Impact on Customers: No impact on live customer solutions expected.

Release details:

CES Release 3.0.0 is for deployment of new ServiceNow GeoIp Subscription API package which would deploy the IP Geo Agreement service with support for Service Now.

Release Highlights:

  • The above release package deployment enables the creation of new IP Geo subscriptions for the new Customer's Sitecore licenses through Service Now.
  • It also ensures that the agreement signature for the “Terms and Conditions” for the actual IP Geo Service are accepted while creating the new IP Geo Subscriptions.
  • Aside from creation of IP Geo subscriptions, it can also retrieve the subscription details of the existing IP Geolocation subscriptions and can also delete the existing IP Geo subscriptions through valid customer’s Sitecore Licenses.
  • It performs all these actions through the ServiceNow API for IP Geo Agreement service which gets provisioned on Sitecore’s production CES Azure subscription.

 


- Posted on Nov 15, 01:00 UTC

COMPLETED: 

The deployment has been completed successfully on Production environment for Sitecore CES. 

All the post deployment smoke test scenarios have passed successfully for the production env.

This concludes the deployment of this release.


- Posted on Nov 15, 17:54 UTC

IN PROGRESS: The deployment procedures are in progress.
- Posted on Nov 15, 08:32 UTC

  Nov 14, 2019

Azure Marketplace Deployment

Sitecore Cloud Operations team is preparing a planned deployment on the Azure Marketplace infrastructure with fixes for the current marketplace deployment issues. 

Affected Sitecore Cloud Service:   Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

• Sitecore Connect for Salesforce Marketing Cloud Behavioral Data Exchange 3.0 Initial Release API Metadata
• Sitecore Connect for Salesforce Marketing Content Exchange 2.0 Initial Release API Metadata
• Sitecore Connect for Salesforce Marketing Content Exchange 3.0 Initial Release API Metadata
• Removed Sitecore Connect for Salesforce Marketing Cloud 1.0.0 API Metadata
- Posted on Nov 14, 07:00 UTC

Completed: Sitecore Team has completed the scheduled deployment successfully. 
- Posted on Nov 14, 09:39 UTC

In-Progress: Sitecore Cloud Operations team will perform the scheduled deployment now 
- Posted on Nov 14, 06:58 UTC

Scheduled: This deployment has been scheduled for November 14 , 07:00 UTC
- Posted on Nov 14, 00:00 UTC

  Nov 07, 2019

Azure availability Issues in West Europe Region

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the Managed Cloud & xDB Cloud customers in West Europe are affected.

Affected Sitecore Cloud Service: Sitecore Managed Cloud & xDB Cloud customers.

Customer identification: Few Managed Cloud customers & xDB Cloud Customers hosted in the West Europe Azure region.

Issue Description: Through Azure we have learnt that Azure instances hosted in West Europe Region are unreachable . This is because of an underlying Storage incident and is under investigation by Azure

Impact: The issue occurred on 02:40 UTC ,  Nov 7 , 2019  a subset of customers will be facings issues connecting to resources hosted in the West Europe Region. 

Impacted services: Azure Resources hosted in West Europe Region

Additional references:  https://status.azure.com/en-us/status


- Posted on Nov 07, 02:40 UTC

Resolved: Azure engineers mitigated the impact to the first two scale units by deploying a platform hotfix. Mitigation to the third scale unit was delayed due to compatibility issues identified when applying the mitigation. A small subset of customers may continue to experience residual impact. Communications continue to be sent through the Service Health section of their Azure Portal. Engineers will continue to investigate to establish the full root cause, which will be published within 72 hours.
- Posted on Nov 07, 12:20 UTC

In-Progress: The issue is under investigation and Azure engineers are trying to resolve this issues asap. We will keep you posted .
- Posted on Nov 07, 05:54 UTC

Identified: This issue has been identified from the Azure status page
- Posted on Nov 07, 00:00 UTC

  Nov 04, 2019

Azure Marketplace deployment issues

Sitecore team have identified an issue related to failed deployments while performing marketplace deployments for Sitecore version 9.1.x scaled instance in XP, XM and XDB . Sitecore Engineers are working on it to fix the issue as soon as possible. 
- Posted on Oct 18, 00:00 UTC

Resolved: 

Sitecore Engineers have fixed this issue now. The fixes have been deployed and the marketplace deployments are successful . However , there are very rare chance of deployment failure  for which we would request to re-deploy again. 

 


- Posted on Nov 04, 08:31 UTC

In-Progress: Sitecore Engineers continue to work to resolve this issue.
- Posted on Oct 25, 20:20 UTC

Identified: Marketplace cannot currently deploy Sitecore 9.1.x scaled instance in XP, XM and XDB
- Posted on Oct 18, 00:00 UTC

  Nov 04, 2019

Azure Marketplace Deployment

Sitecore Cloud Operations team is preparing a planned deployment on the Azure Marketplace infrastructure with fixes for the current marketplace deployment issues. 

Affected Sitecore Cloud Service:   Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  •  Sitecore 9.1 Initial Release, Sitecore 9.1 Update-1 and Sitecore 9.2 Initial Release arm templates updates to overcome Azure intermittent issues

 


- Posted on Nov 04, 07:00 UTC

Completed: Sitecore Engineers have successfully completed the scheduled deployment . 
- Posted on Nov 04, 08:29 UTC

In Progress: Sitecore Engineers are performing this deployment currently .
- Posted on Nov 04, 07:12 UTC

Scheduled: This deployment has been scheduled for November 4 , 07:00 UTC
- Posted on Nov 04, 07:00 UTC

  Oct 31, 2019

Azure Marketplace 'Location' List Selection Issue

The Sitecore team has identified an issue related to the "Location" list selection box in the Region tab for the Azure Marketplace deployment interface.  Sitecore Engineers are aware and working to fix the issue as soon as possible. 
- Posted on Oct 25, 00:00 UTC

Completed: 

Microsoft corrected the underlying issue; the "Locations" list now populates as expected in the Sitecore Azure Marketplace. 


- Posted on Oct 31, 13:23 UTC

In Progress: Sitecore Engineers are working to resolve this issue.
- Posted on Oct 30, 13:05 UTC

Identified: Azure Marketplace deployments cannot be completed.
- Posted on Oct 25, 00:00 UTC

  Oct 31, 2019

Azure Storage Issue for West Europe - Mitigated

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the Managed Cloud & xDB Cloud customers in West Europe are affected.

Affected Sitecore Cloud Service: Sitecore Managed Cloud & xDB Cloud customers.

Customer identification: Few Managed Cloud customers & xDB Cloud Customers hosted in the West Europe Azure region.

Issue Description: Through Azure we have learnt that some instances of a backend service responsible for controlling Storage requests became unhealthy.

Impact:  Between 10:17 and 13:52 UTC on 30 Oct 2019, a subset of customers, and Azure services, in West Europe may have experienced difficulties connecting to resources hosted in this region stemming from an identified Storage issue.

Impacted services: Storage; SQL Database; Azure Search; Automation; Key Vault; App Service; Log Analytics and Azure Services.

Additional references:  https://status.azure.com/en-us/status/history/

Mitigation: Microsoft performed a change to the impacting backend service configuration to mitigate the issue.

 

- Posted on Oct 30, 18:30 UTC

Identified: 
- Posted on Oct 31, 00:00 UTC

  Oct 30, 2019

Azure Virtual Machines - Mitigated

Summary of Impact: Between 23:40 UTC on 29 Oct 2019 and 06:15 UTC on 30 Oct 2019, a subset of customers using Virtual Machines may have received failure notifications when performing service management operations - such as create, update, delete - for resources hosted in these regions.

Preliminary Root Cause: Engineers determined that an error in a recent deployment task impacted connectivity for backend services, preventing requests from completing.

Mitigation: Azure Engineers rolled back the recent deployment task to mitigate the issue.


- Posted on Oct 29, 23:30 UTC

Identified: 

This issue has been identified from the Azure status page.

Azure Engineers will continue to investigate to establish the full root cause and prevent future occurrences. Stay informed about Azure service issues by creating custom service health alerts:  for video tutorials and  for how-to documentation.


- Posted on Oct 30, 07:00 UTC

  Oct 30, 2019

Storage - West Europe - Mitigated

Summary of impact: Between 10:17 and 13:52 UTC on 30 Oct 2019, a subset of customers, and Azure services, in West Europe may have experienced difficulties connecting to resources hosted in this region stemming from an identified Storage issue.

Preliminary root cause: Engineers determined that some instances of a backend service responsible for controlling Storage requests became unhealthy.

Mitigation: Engineers performed a change to the impacting backend service configuration to mitigate the issue.


- Posted on Oct 30, 10:00 UTC

Identified: Engineers will continue to investigate to establish the full root cause and prevent future occurrences. Stay informed about Azure service issues by creating custom service health alerts: https://aka.ms/ash-videos for video tutorials and https://aka.ms/ash-alerts for how-to documentation.
- Posted on Oct 30, 00:00 UTC

  Oct 24, 2019

xDB Cloud Core services upgrade

Sitecore team is performing xDB Cloud Core service upgrade.

No impact on existing customers expected.

Release details: MongoDB 3.6 support for Sitecore 8.2 Update 7.


 

- Posted on Oct 22, 13:00 UTC

Finished: Deployment has been completed successfully.
- Posted on Oct 24, 07:33 UTC

Started: Deployment has been started.
- Posted on Oct 22, 00:00 UTC

  Oct 24, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 3.0.1.0 to Sitecore Managed Cloud Services.

 

Affected Sitecore Cloud Service: Sitecore Managed Cloud Core service.

Expected impact on customers: No downtime and no impact on live customer solutions expected.


- Posted on Oct 24, 02:30 UTC

Completed: Sitecore Cloud Operations team have successfully completed the deployment 
- Posted on Oct 24, 04:03 UTC

In-Progress: Sitecore Cloud Operations team is performing this planned deployment now.
- Posted on Oct 24, 02:25 UTC

Scheduled: This upgrade has been scheduled
- Posted on Oct 23, 00:00 UTC

  Oct 23, 2019

Azure Storage Issue for West Europe-Mitigated

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the Managed Cloud customers in West Europe are affected.

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers.

Customer identification: Few Managed Cloud customers hosted in West Europe Azure region.

Impact: Between 21:15 UTC on 22 Oct 2019 and 00:23 UTC on 23 Oct 2019, a subset of customers using Storage in West Europe may have experienced difficulties connecting to resources hosted in this region.

Impacted services: Storage; SQL Database; Azure Search; Automation; Key Vault; App Service; Log Analytics

Additional references:  https://status.azure.com/en-us/status/history/

Mitigation: Microsoft deployed a platform hotfix to correct the inconsistency, restoring dependent services and mitigating the issue.


- Posted on Oct 23, 00:00 UTC

Resolved: The issue has been resolved. Azure Status page looks healthy. For more detail refer: https://status.azure.com/en-us/status/history
- Posted on Oct 23, 02:10 UTC

Identified: This issue has been identified from the Azure status page
- Posted on Oct 23, 00:00 UTC

  Oct 22, 2019

Azure portal Sign In Failure - West Europe

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the xDB Cloud customers and Managed Cloud Customers in West Europe are affected.

Affected Sitecore Cloud Service: Sitecore Managed Cloud

Customer identification: Managed Cloud customers hosted in West Europe

Impact: The problem reported by Microsoft affects trying to log in to the Azure Portal impacting. 

Additional references: https://status.azure.com/ru-ru/status

Sitecore engineers will closely follow up on the issue and post further updates under this event article on the status page.
- Posted on Oct 22, 06:40 UTC

Resolved: The issue has been resolved. 
- Posted on Oct 22, 13:54 UTC

Identified: Sitecore Cloud Operations have identified the issue and currently working with Microsoft Support to get ETAs and plans of issue mitigation.
- Posted on Oct 22, 00:00 UTC

  Oct 22, 2019

Sitecore Managed Cloud - Azure Storage Issue for West Europe

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the Managed Cloud customers in West Europe are affected.

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers.

Customer identification: Few Managed Cloud customers hosted in West Europe Azure region.

Impact: Starting at 23:20 UTC on 21 Oct 2019,  customers using Storage in West Europe may experience difficulties connecting to resources hosted in this region.Other services that leverage Storage in this region, such as Virtual Machines, Azure SQL, Data Explorer, Logic Apps, Log Analytics, Data Factory V1/V2, Azure Monitor, App Service (Web Apps), Site Recovery, Backup, Application Insights, or Automation, may also experience impact related to this.

Additional referenceshttps://status.azure.com/en-us/status 

Mitigation: Microsoft Azure Engineers have determined that this is caused by a single underlying Storage scale unit which is currently under investigation
- Posted on Oct 21, 11:00 UTC

Resolved: The issue has been resolved. Azure Status page looks healthy. For more detail refer: https://status.azure.com/en-us/status/history
- Posted on Oct 22, 06:31 UTC

Identified: This issue has been identified from the Azure status page
- Posted on Oct 22, 00:00 UTC

  Oct 22, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 3.0.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Sitecore Managed Cloud Core service.

Expected impact on customers: No downtime and no impact on live customer solutions expected.


- Posted on Oct 22, 02:00 UTC

Completed: Sitecore Cloud Operations team have completed the scheduled deployment successfully.
- Posted on Oct 22, 04:11 UTC

In Progress: We will start the upgrade activities now as per schedule.
- Posted on Oct 22, 03:02 UTC

Scheduled: This upgrade has been scheduled on 22 October, 2019
- Posted on Oct 19, 00:00 UTC

  Oct 16, 2019

Managed Cloud Monitoring Update

Sitecore Cloud Operations team is preparing to implement a new monitoring system called CAMS - CloudOps Automated Monitoring System. As part of the the implementation, the Action Groups and Log Analytics will be modified on all environments. The new system will improve the effectiveness of the monitoring and enable the CloudOps team to respond to challenges faster.


Affected Sitecore Cloud Service:
  Sitecore Managed Cloud.

Expected impact on customers:  No impact to the existing Sitecore Customer's Cloud resources.

 

Status update:  The update process is still ongoing. and the expected end date has been changed to Oct. 16.


- Posted on Oct 07, 00:00 UTC

Resolved: Sitecore Cloud Operations team have completed the monitoring update successfully .
- Posted on Oct 16, 09:08 UTC

Identified: Sitecore Cloud Operations team is performing the activity.
- Posted on Oct 01, 00:00 UTC

  Oct 14, 2019

Azure SQL Database traffic migration to newer Gateways

 

Gateways built on new hardware are being added to SQL DB in various regions. This will allow logins to be serviced by more than one Gateway in these regions, leading to better response times and reduced latency.

This will change the public IP address to which DNS will resolve for your SQL Database, effective October 14, 2019.

Impact: Potential loss of connectivity for Customers using IP restriction rules on Azure SQL Databases.

For the majority of customers, we expect this change will not impact connectivity to SQL Database. However, we recommend that you white list IP addresses for all Gateways in the regions listed at the bottom of this message, as outlined in the table here.

 More details about decommissioning process given in the following article: Azure SQL Database traffic migration to newer Gateways.

- Posted on Oct 14, 00:00 UTC

Resolved: This activity has been completed by Microsoft Azure team
- Posted on Oct 14, 23:59 UTC

Scheduled: This migration has been scheduled to complete on October 14, 2019. 
- Posted on Sep 13, 03:54 UTC

Identified: This issue has been identified from the notification email sent by Microsoft Azure team. 
- Posted on Sep 13, 00:00 UTC

  Oct 10, 2019

Sitecore Azure Marketplace Core Services Update

Sitecore Cloud Operations team is preparing a planned upgrade on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service:   Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Sitecore 9.2 Initial Release and  Sitecore 9.1 Update-1, scale-up hosting plan service tier for XPSingle and XMSingle topologies from B3 to S3.

 


- Posted on Oct 09, 09:58 UTC

Completed: 

Production marketplace has been successfully updated with the release package.

All the post deploy validations are passed successfully.


- Posted on Oct 10, 05:11 UTC

In Progress: Packages Upgrade is in progress
- Posted on Oct 09, 09:56 UTC

Identified: 
- Posted on Oct 09, 00:00 UTC

  Oct 01, 2019

Azure classic alerts migration

Azure has started classic alerts migration which should be finished by the end of September 2019.

Some Managed Cloud customers may receive emails from Azure like "You’ve been added to an Azure Monitor action group".

There is no impact and no actions required.

More details here: https://docs.microsoft.com/en-us/azure/azure-monitor/platform/monitoring-classic-retirement#retirement-of-classic-monitoring-and-alerting-platform


- Posted on Sep 19, 00:00 UTC

Finished: Alerts migration has been finished successfully.
- Posted on Oct 01, 12:41 UTC

In progress: 

During migration all alerts are being fired again which results in a false-positive alert notifications.

Some customers may receive duplicated alert notifications.


- Posted on Sep 20, 08:08 UTC

Identified: Migration is in progress.
- Posted on Sep 19, 00:00 UTC

  Sep 28, 2019

Sitecore Managed Cloud - Azure App Service Issue in West US

During daily monitoring activities, Sitecore Cloud Operations engineers identified an issue with Microsoft Azure due to which the Managed Cloud customers using App Service in West US may experience intermittent HTTP 504-level and 404-level response codes experience timeouts or high latency when accessing App Service

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers

Customer identification: The Managed Cloud customers using App Service in West US.

Summary of impact: Starting at 28 Sep 2019 04:21 UTC, Managed Cloud customer using App Service in West US who may receive intermittent HTTP 504-level and 404-level response codes, experience timeouts or high latency when accessing App Service (Web, Mobile and API Apps) deployments hosted in this region. 

 
 

Additional references: https://app.azure.com/h/G_FN-1P0/2e2625

 


- Posted on Sep 28, 00:00 UTC

Resolved: As per the update from azure , the issue was self-healed by the Azure platform once traffic normalized.
- Posted on Sep 28, 07:11 UTC

Identified: 
- Posted on Sep 28, 00:00 UTC

  Sep 28, 2019

Sitecore Managed Cloud - Solr False Alert Notifications

During daily monitoring activities, Sitecore Cloud Operations engineers identified an issue with Solr due to which Managed Cloud customers may receive false heartbeat alert notifications.

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers with Solr deployments.

Summary of impact: Starting at 18:00 UTC, customers using Solr may receive false heartbeat alert notifications for Solr nodes. There is no impact on live customer solutions expected.

Additional referenceshttps://status.searchstax.com/incidents/pvbcj8qg6z0t
- Posted on Sep 26, 18:00 UTC

Resolved: This issue is resolved now. 
- Posted on Sep 28, 05:30 UTC

In Progress: 

Managed Cloud customers may receive false heartbeat alerts for Solr nodes.


- Posted on Sep 26, 18:00 UTC

Identified: 
- Posted on Sep 26, 00:00 UTC

  Sep 27, 2019

Azure Marketplace Deployment failure for Sitecore version 9.1 and above for XM, XP topology

During daily monitoring activities, Sitecore Cloud Operations engineers identified an issue with Sitecore Azure marketplace deployment failure for sitcore version 9.1 and above for XM and XP topology due to which the customers may experience deployment failure while performing Azure marketplace deployment for 9.x XM,XP versions.

Sitecore team is working on it to resolve the issue as soon as possible.

 

Affected Sitecore Cloud Service: Sitecore Azure marketplace

 

Impact on Customers:    No impact on live customer solutions expected. New azure marketplace deployments may fail when opted 9.1 and above for XM and XP toplogy . 

 

- Posted on Sep 20, 03:43 UTC

Resolved: Sitecore  team have fixed the issue with the recent failures with marketplace .
- Posted on Sep 27, 10:54 UTC

In Progress: Sitecore team is working to fix the issue with azure marketplace deployment for Sitecore version 9.1 and above for XM and XP topology
- Posted on Sep 23, 03:46 UTC

Identified: 

This issue has been identified from the Sitecore cloud operations team.


- Posted on Sep 20, 03:43 UTC

  Sep 27, 2019

Sitecore Azure Marketplace Core Services Update

Sitecore Cloud Operations team is preparing a planned upgrade on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service:   Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

·      Removal of AspNetCoreRuntime Site Extensions for Sitecore 9.1 Initial Release, Sitecore 9.1 Update-1 and Sitecore 9.2 Initial Release.

·       Sitecore Connect for Salesforce Marketing Cloud Behavioral Data Exchange 1.0 Initial Release for Sitecore 9.0 Update-1 and  Sitecore 9.0 Update-2.

·       Sitecore Connect for Salesforce Marketing Cloud Behavioral Data Exchange 2.0 Initial Release for Sitecore 9.1 Initial Release and  Sitecore 9.1 Update-1.

·       Sitecore Connect for Sitecore CMP 1.0 Initial Release for Sitecore 9.1 Initial Release and  Sitecore 9.1 Update-1.


- Posted on Sep 27, 10:27 UTC

Resolved: Sitecore Cloud Operations team have completed the marketplace deployment successfully .
- Posted on Sep 27, 10:53 UTC

In-Progress: Sitecore Cloud Operations team is performing marketplace deployment currently
- Posted on Sep 27, 10:29 UTC

Identified: Sitecore Cloud Operations team is performing this deployment.
- Posted on Sep 27, 00:00 UTC

  Sep 22, 2019

Sitecore Managed Cloud - Azure Application Insights Access Issues

During daily monitoring activities, Sitecore Cloud Operations engineers identified an issue with Microsoft Azure due to which the Managed Cloud customers across Southeast Asia may have experienced intermittent connectivity issues while using Application Insights.

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers 

Customer identification: The Managed Cloud customers having their Application Insights in Southeast Asia.

Summary of impact: Between 10:08 UTC and 10:36 UTC on 21 Sept 2019 , customers using Application Insights in Southeast Asia might have experienced intermittent latency, data access issues, and data gap issues when accessing application data in this region. This includes data being sent by non-retrying SDKs (including, but not limited to JavaScript SDKs).

Additional references:   https://app.azure.com/h/1_ZM-PT0/e101f1 
- Posted on Sep 21, 10:00 UTC

MITIGATED: 

As per Microsoft , the Azure Engineers scaled down SNAT ports and restarted the role instances to mitigate the issue.

Sitecore Cloud Operations will continue to actively monitor this and have also requested for the Root cause analysis from Azure regarding the same.


- Posted on Sep 22, 04:35 UTC

Identified: 
- Posted on Sep 22, 00:00 UTC

  Sep 15, 2019

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with an internal Release Nuget package 0.343, targeted for Sitecore Email Cloud App Updates & Fixes.

These changes are focused on Sitecore Email Cloud solution for EXM internal improvements.

Release Highlights:

  • EXM invoicing: Incorrect quota calculated when order is upgraded.
  • EXM Invoicing: Incorrect Previous Consumption value is calculated.
  • Bug fixes for Errors in generated EXM invoice files.
  • Bug fixes for "Wrong currency" in the generated EXM invoice files . 
  • Other low priority  EXM Invoicing fixes. 

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.

 
 

- Posted on Sep 13, 04:00 UTC

COMPLETED: This upgrade has been completed.
- Posted on Sep 15, 07:48 UTC

STARTED: This upgrade in the form of deployment of the release packages is in progress.
- Posted on Sep 13, 06:00 UTC

Identified: 
- Posted on Sep 13, 00:00 UTC

  Sep 11, 2019

Sitecore Managed Cloud - Azure Intermittent Connectivity Issues on Australia East

During daily monitoring activities, Sitecore Cloud Operations engineers identified an issue with Microsoft Azure due to which Managed Cloud customers across Australia East may have experienced intermittent connectivity issues while connecting to azure resources hosted in Australia East or logging in to the Azure Portal.

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers hosted on Australia East

Customer identification: Sitecore Managed Cloud customers

Impact: The problem reported by Microsoft results in intermittent connectivity issues while connecting to azure resources hosted in Australia East  or logging in to the Azure Portal with a Microsoft account.

Additional references:  https://status.azure.com/en-us/status 


- Posted on Sep 11, 00:36 UTC

Resolved: Microsoft Azure Engineers have determined that the issue was self-healed by the Azure platform.
- Posted on Sep 11, 01:40 UTC

Identified: This issue has been identified from the Azure status page.
- Posted on Sep 11, 00:36 UTC

  Sep 10, 2019

Sitecore Managed Cloud – Updating classic alerts to enhanced monitoring package

Microsoft deprecates classic alerts from August 31st 2019, therefore Sitecore Cloud Operations is upgrading all Managed Cloud customers provisioned before May 2019 with the updated basic monitoring package to retain consistent infrastructure availability monitoring delivered by Sitecore Cloud Operations team 24x7x365. For more details, please refer to:


- Posted on Sep 04, 08:00 UTC

Additional notice: 

Some customers may not have a new monitoring package deployed due to one of the following reasons:

  • Originally provisioned resources removed
  • Unsupported Sitecore topology: xP0, xM0, xDB0
  • Unsupported Sitecore version: 9.2.0

Note: Customers with unsupported version or topology will receive a monitoring package once available. 


- Posted on Sep 10, 14:57 UTC

Completed: 

Deployment has been finished successfully.

Please contact Sitecore Support in case of any questions.


- Posted on Sep 10, 13:05 UTC

In progress: 

Deployment is in progress. Some customers may start receiving new alert notifications.

Cloud Operations team may temporary disable some new alert rules in order to avoid unnecessary notifications.


- Posted on Sep 04, 13:49 UTC

Started: Deployment has been started. No impact expected.
- Posted on Sep 04, 07:10 UTC

Scheduled: 

Between 04-Sept – 11-Sep Sitecore Cloud Operations team will be replacing Azure classic alerts with basic monitoring package.

No impact expected.


- Posted on Aug 31, 00:00 UTC

  Sep 10, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 2.3.1.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Sitecore Managed Cloud Core service.

Expected impact on customers: No downtime and no impact on live customer solutions expected.


- Posted on Sep 10, 08:00 UTC

Completed: Sitecore Cloud Operations team have completed the scheduled deployment successfully. 
- Posted on Sep 10, 10:38 UTC

In Progress: We will start the upgrade activities now as per schedule
- Posted on Sep 10, 08:12 UTC

Scheduled: This upgrade has been scheduled. 
- Posted on Sep 02, 13:01 UTC

  Sep 05, 2019

SparkPost - Delays on message delivery to yahoo


- Posted on Sep 05, 00:00 UTC

Resolved: 

This issue have been resolved. More information can be found on https://status.sparkpost.com/.


- Posted on Sep 05, 17:59 UTC

Identified: 

Yahoo had a DNS issue that caused an increase in "delays"/4xx errors on outbound message delivery to yahoo recipients for some SparkPost and SparkPost Enterprise customers (US +EU).


- Posted on Sep 05, 00:00 UTC

  Aug 19, 2019

Sitecore Azure Marketplace Core Services Update

Sitecore Cloud Operations team is preparing a planned upgrade on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service:   Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • SXA 1.8 Initial Release & Sitecore Experience Accelerator Storefront 1.4 Initial Release compatibility updated.
  • Marketplace SPA Auditing.


- Posted on Aug 12, 09:44 UTC

COMPLETED: This upgrade has now been completed.
- Posted on Aug 19, 19:07 UTC

In Progress: Sitecore Azure Marketplace Core services upgrade is in progress.
- Posted on Aug 19, 19:05 UTC

STARTED: This upgrade has been started.
- Posted on Aug 14, 10:19 UTC

Identified: 
- Posted on Aug 12, 00:00 UTC

  Aug 16, 2019

Azure Services - Connectivity Issues for Some Resources - South Central US

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the xDB Cloud and Managed Cloud customers in the South Central US region are affected.

Affected Sitecore Cloud Service: Sitecore xDB Cloud & Managed Cloud customers.

Customer identification: A few customers in the South Central US region are affected.

 Impact: Between Aug 16, 14:16 - Aug 16, 21:36 UTC, customers may have experienced some issues connecting to their resources.

Additional references:  https://app.azure.com/h/KT5G-BC8/c4f7bb

 

Mitigation:  Microsoft Azure Engineers replaced the equipment affecting the resources, and have mitigated the issue.


- Posted on Aug 16, 14:16 UTC

Resolved: According to the Azure status update, this has been resolved & mitigated
- Posted on Aug 16, 21:36 UTC

Identified: Microsoft Engineers identified Azure Service connectivity issues in the South Central US Data Center
- Posted on Aug 16, 14:16 UTC

  Aug 13, 2019

Sitecore Managed Cloud - Azure Storage Issue for West Europe

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the Managed Cloud customers in West Europe are affected.

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers.

Customer identification: Few Managed Cloud customers hosted in West Europe Azure region.

Impact: Between 21:57 and 23:29 UTC on 12 Aug 2019, customers might have received failure notifications when performing service management operations - such as create, update, delete - for their Managed cloud  resources hosted in this West Europe Azure region.

Additional references:  https://app.azure.com/h/5LQ7-HC8/36c95a

Mitigation: Microsoft Azure Engineers have performed a change to the service configuration to mitigate the issue.

 


- Posted on Aug 12, 21:57 UTC

RESOLVED: According to the Azure status update, this has been resolved & mitigated
- Posted on Aug 13, 07:10 UTC

Identified: 
- Posted on Aug 13, 00:00 UTC

  Aug 11, 2019

Sitecore Managed Cloud - Application Insights Data Latency

Managed Cloud customers using ApplicationInsights in East US may have experienced increased latency or minor delays when accessing monitoring data between 22:00 UTC on August 10 2019 and 2:55 UTC on August 11 2019. Azure technicians restarted a relevant backend service and the issue has now been successfully mitigated.
- Posted on Aug 10, 22:00 UTC

Resolved: MS techs have resolved the latency issues by restarting a relevant backend service and verifying it is healthy.
- Posted on Aug 11, 16:19 UTC

Identified: 
- Posted on Aug 11, 00:00 UTC

  Aug 07, 2019

Sitecore Azure Marketplace Core services update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Commerce 9.2 Initial Release for Sitecore 9.2 Initial Release
  •  Storefront 3.0 Initial Release for Sitecore 9.2 Initial Release

- Posted on Aug 07, 07:00 UTC

Completed: Sitecore Cloud Operations team have completed the scheduled deployment successfully
- Posted on Aug 07, 11:34 UTC

Scheduled: This upgrade has been scheduled.  
- Posted on Aug 07, 07:00 UTC

In Progress: We will start the upgrade activities now as per schedule.
- Posted on Aug 07, 07:00 UTC

  Aug 05, 2019

Sitecore Azure AppSource - Existing Test Drive Production Deployments Affected

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Sitecore Azure AppSource due to which the existing deployments of Sitecore Experience® Platform™ (XP) are inaccessible.

Affected Sitecore Cloud Service: Sitecore Azure AppSource.


Customer identification: 
All existing & new Sitecore AppSource customers.

Issue Description: 

The existing Test Drive Azure App Source Sitecore XP instances are inaccessible, due to incorrect licenses configured for the app services.


Impact:
  This outage will impact the deployment of existing  Sitecore Experience® Platform™ (XP)  for Test Drive purposes.

Existing  & new customers who wish to try out or get familiar with the Sitecore XP before subscribing for Sitecore XP cloud , Managed cloud , etc will be impacted

 

Sitecore Cloud engineers will closely follow up on the issue and post further updates under this event article on status page.


- Posted on Aug 01, 20:00 UTC

RESOLVED: Removed the app source environment instances which were having such issues, in order to enable the provision of correct/properly configured test drive resource groups.
- Posted on Aug 05, 08:20 UTC

Identified: 
- Posted on Aug 02, 00:00 UTC

  Aug 05, 2019

Sitecore Azure AppSource - New Deployments Failing

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Sitecore Azure AppSource due to which new deployments of Sitecore Experience® Platform™ (XP) are failing.

Affected Sitecore Cloud Service: Sitecore Azure AppSource.


Customer identification: 
All new Sitecore AppSource customers.

Issue Description: 

Mongo DB packages deployments are failing during App Source test drive instances deployments. Hence this is resulting in failures during creation of the new Sitecore App Source XP environments.


Impact:
  This outage will impact the deployment of new Sitecore Experience® Platform™ (XP)  for Test Drive purposes initiated through  https://appsource.microsoft.com/en-us/product/web-apps/sitecore.sxp_824?tab=Overview

New customers who wish to try out or get familiar with the Sitecore XP before subscribing for Sitecore XP cloud , Managed cloud , etc will be impacted.

 

Sitecore Cloud engineers will closely follow up on the issue and post further updates under this event article on status page.


- Posted on Aug 01, 21:00 UTC

RESOLVED: 

Sitecore Product team identified an issue with the expired Mongo DB authentication keys due to which the new app source deployments were failing.

After we deployed the hotfix in the App Source Production environment , the new deployments are now succeeding.


- Posted on Aug 05, 08:05 UTC

IN PROGRESS: 

Sitecore Cloud Operations is also working with MS Azure support & mLab support for troubleshooting & fixing the same.

 


- Posted on Aug 02, 07:20 UTC

Identified: 
- Posted on Aug 02, 00:00 UTC

  Aug 05, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 2.3.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Sitecore Managed Cloud Core service.

Expected impact on customers: No downtime and no impact on live customer solutions expected.


- Posted on Aug 05, 07:00 UTC

Completed: Sitecore Cloud Operations team have completed the scheduled deployment successfully.
- Posted on Aug 05, 07:48 UTC

In Progress: We will start the upgrade activities now as per schedule.
- Posted on Aug 05, 07:00 UTC

Scheduled: This upgrade has been scheduled.  
- Posted on Aug 01, 00:00 UTC

  Aug 01, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 2.2.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Sitecore Managed Cloud Core service.

Expected impact on customers: No downtime and no impact on live customer solutions expected.


- Posted on Aug 01, 12:00 UTC

Completed: Sitecore Cloud Operations team have completed the scheduled deployment successfully. 
- Posted on Aug 01, 13:30 UTC

In Progress: We will start the upgrade activities now as per schedule.
- Posted on Aug 01, 12:00 UTC

Scheduled: This upgrade has been scheduled. 
- Posted on Jul 23, 13:44 UTC

  Jul 31, 2019

Sitecore Azure Marketplace Core services update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Stylelabs 1.0 Initial Release
  • SPE Update for Sitecore Experience Accelerator 1.9 Initial Release

 


- Posted on Jul 31, 07:00 UTC

Completed: Sitecore Cloud Operations team have completed the scheduled deployment successfully. 
- Posted on Jul 31, 09:00 UTC

In-Progress: We will start the upgrade activities now as per schedule.
- Posted on Jul 31, 06:50 UTC

Scheduled: This upgrade has been scheduled.  
- Posted on Jul 30, 00:00 UTC

  Jul 30, 2019

Sitecore Managed Cloud-Azure Login Issues

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which Managed Cloud customers across any region may have experienced  authentication issues  when logging in to the Azure Portal.

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers

Customer identification: Sitecore Managed Cloud customers

Impact: The problem reported by Microsoft results in intermittent error messages and failures when logging in to the Azure Portal with a Microsoft account.

Additional references:  https://status.azure.com/en-us/status 

 


- Posted on Jul 30, 21:00 UTC

Resolved: Microsoft Azure Engineers have corrected the issue which restored Microsoft Account services for customers.
- Posted on Jul 30, 22:24 UTC

Identified: This issue has been identified from the Azure status page.
- Posted on Jul 30, 21:00 UTC

  Jul 30, 2019

Sitecore Email Cloud Sparkpost API errors

Sparkpost reported an elevated level of API and UI errors and latency for some US customers (US hosted only).

Additional references: https://status.sparkpost.com/incidents/qmzh1lktl7k8


- Posted on Jul 30, 21:43 UTC

Resolved: This incident has been resolved.
- Posted on Jul 30, 22:20 UTC

Identified: The issue has been identified and a fix is being implemented.
- Posted on Jul 30, 21:45 UTC

  Jul 22, 2019

Sitecore Email Cloud Sparkpost API errors

Elevated 5xx API error rates and increased latency for some SparkPost and SparkPost Enterprise customers (US hosted only)
- Posted on Jul 22, 04:33 UTC

Resolved: This incident has been resolved.
- Posted on Jul 22, 05:30 UTC

Identified: The issue has been identified and a fix is being implemented.
- Posted on Jul 22, 04:33 UTC

  Jul 05, 2019

Sitecore Managed Cloud - Azure Connectivity Issues for UK South

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the Managed Cloud customers across UK South region may be affected.

Affected Sitecore Cloud Service:  Sitecore Managed Cloud customers

Customer identification:   Sitecore Managed Cloud customers in the UK South Region

Impact:  The problem reported by Microsoft affects the Sitecore Managed cloud customers leveraging Storage in the UK South Region, Between 06:00 UTC and 16:25 UTC on 04 July 2019.

They might have experienced service availability issues. In addition, resources with dependencies on Storage, may also have experienced downstream impact in the form of availability issues.  These impacted services include App Services, Virtual Machines, Backup, KeyVault, App Insights, Logic Apps, and Azure Data Factory v2.

Additional references:  https://status.azure.com/en-us/status 

Sitecore engineers will closely follow up on the issue and post further updates under this event article on status page. 


- Posted on Jul 04, 14:00 UTC

MITIGATED: As per the update from Microsoft Azure Engineers, they manually applied load balancing configuration changes to bring the affected storage scale unit back to a healthy state. As a consequence, resource utilization levels were brought back to normal , hence mitigating the issue.
- Posted on Jul 05, 07:20 UTC

Identified: 
- Posted on Jul 05, 00:00 UTC

  Jul 03, 2019

Sitecore Managed Cloud - Azure Infrastructure Issues

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure due to which some of the Managed Cloud customers across any region may be affected.

 

Affected Sitecore Cloud Service: Sitecore Managed Cloud customers


Customer identification:
All Sitecore Managed Cloud customers

Impact: The problem reported by Microsoft affects Azure Diagnostics logs, Autoscale, Classic Alerts.

 

A subset of customers using Diagnostic Logs may receive failure notifications when performing service management operations - such as create, update, delete - for resources. Impact will include Autoscale settings, Classic alerts and Diagnostics settings. Existing alert and settings are not impacted.

 

Additional references:  https://status.azure.com/en-us/status 

 

Sitecore engineers will closely follow up on the issue and post further updates under this event article on status page.
- Posted on Jul 03, 02:00 UTC

IDENTIFIED: This issue has been identified from the Azure status page.
- Posted on Jul 03, 13:30 UTC

IN PROGRESS: 

As per Microsoft, Azure engineers have been able to identify possible underlying cause, and are working to determine mitigation options. 

 Sitecore Cloud Operations will closely follow up on the issue and post further updates under this event article on status page.


- Posted on Jul 03, 08:02 UTC

Resolved: Microsoft Azure Engineers have corrected the issue which were causing the impact on Autoscale settings, Classic alerts and Diagnostics settings.
- Posted on Jul 03, 08:00 UTC

  Jun 19, 2019

190619 Sitecore Managed Cloud - Problems Creating and Moving Azure Resources

Managed Cloud customers in the affected Azure regions may experience issues when changing Web APP infrastructure via the Azure portal. Additionally, Azure web app resources with autoscaling and loading site metrics may be affected per Azure issue (_DLQ-VVG). The issue was identified at 6 AM UTC June 19 2019.

The affected list of Azure regions is as follows:

Australia Central, Australia Central 2, Australia East, Australia Southeast, Brazil
South, Canada Central, Canada East, Central India, Central US, East Asia, East US,
East US 2, France Central, France South, Japan East, Japan West, Korea Central,
Korea South, North Central US, North Europe, South Africa North, South Africa
West, South Central US, Southeast Asia, South India, UK South, UK West, West
Central US, West Europe, West India, West US, West US 2

Microsoft engineers are actively investigating this issue.


- Posted on Jun 19, 08:00 UTC

Web App Management Experiencing Problems: An issue has been identified affecting Azure web app management operations such as creating, deleting and moving resources. Customers creating, deleting and moving web app resources may experience 500 errors or delayed performance. Additionally, resources configured for autoscaling may be affected.
- Posted on Jun 19, 19:29 UTC

Resolved: 

Microsoft Azure Engineers have corrected the issue which were causing the impact to Azure App Services.


- Posted on Jun 19, 10:30 UTC

Identified: 
- Posted on Jun 19, 00:00 UTC

  Jun 18, 2019

Sitecore Azure Marketplace Core services update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Sitecore 9.2.0 with modules
    • CDN 1.0.0
    • JSS 12.0.0
    • SXA 1.9.0
    • Salesforce 1.0.0

- Posted on Jun 18, 07:00 UTC

Resolved: The scheduled Azure Marketplace update is succesfully completed.
- Posted on Jun 18, 11:23 UTC

In Progress: 

The update has been started 


- Posted on Jun 18, 07:17 UTC

Scheduled: This upgrade has been scheduled 
- Posted on Jun 17, 10:41 UTC

  Jun 14, 2019

Sitecore Package Management Service Update

New version of Package Management Service with new PackageRepository for Azure Storage account.

Update center will be unavailable for short term.

Impact on Customers: No downtime and no impact on live customer solutions expected.


- Posted on Jun 14, 10:00 UTC

Resolved: Package management service was successfully updated
- Posted on Jun 14, 13:00 UTC

In Progress: The update has been started
- Posted on Jun 14, 11:08 UTC

Scheduled: The update has been sceduled
- Posted on Jun 14, 09:00 UTC

  Jun 14, 2019

Sitecore App Center access issue

Issue: The Sitecore App center is unavailable, due to issues with login functionality.

Impact on Customers: Sitecore customers/partners will not be able to access App center.

Actual impact is that the customers/partners/sitecore account managers will not be able to view the consumption details of IP Geolocation, Sitecore Email Cloud & Sitecore Managed cloud. 

Also, purchasing of a new pricing plan / subscribing to a new Sitecore cloud service / changing the existing price plan is affected.

 


- Posted on Jun 13, 20:49 UTC

Resolved: App center backend issues are now resolved & we have verified that the login now works fine.
- Posted on Jun 14, 06:02 UTC

Identified: Unable to login to the Sitecore App center, due to issues with login functionality. Sitecore engineers are working on resolve the issue.
- Posted on Jun 13, 20:49 UTC

  Jun 13, 2019

Sparkpost Sending Domains service maintenance for EU customers

The "Sparkpost" will  perform maintenance on the Sending Domains service for customers provisioned in the EU region on Thursday June 13th.

 

During the 4 hour maintenance window, the Sending Domains API will be in read-only mode. This maintenance window is only for customers provisioned in the EU.

 

Affected Sitecore Cloud Service: Email Cloud

 

Impact on Customers: In that period of time creating, editing, deleting, or verifying sending domains via the Sending Domain API will not be available for customers provisioned in the EU.

 

 


- Posted on Jun 13, 13:00 UTC

Completed: The upgrade has been successfully completed.
- Posted on Jun 13, 17:10 UTC

In Progress: The upgrade has been started 
- Posted on Jun 13, 13:19 UTC

Scheduled: Sparkpost sending domains service maintenance for EU customers
- Posted on Jun 11, 18:39 UTC

  Jun 12, 2019

Sparkpost sending domains service maintenance

The "Sparkpost" will  perform maintenance on the Sending Domains service in the US region on Wednesday June 12th.

During the 4 hour maintenance window, the Sending Domains API will be in read-only mode.

Affected Sitecore Cloud Service: Email Cloud 

Impact on Customers: In that period of time creating, editing, deleting, or verifying sending domains via the Sending Domain API will not be available


- Posted on Jun 12, 13:00 UTC

Completed: The upgrade has been successfully completed.
- Posted on Jun 12, 17:09 UTC

In Progress: The upgrade has been started
- Posted on Jun 12, 13:00 UTC

Scheduled: Sparkpost sending domains service maintenance
- Posted on Jun 11, 07:52 UTC

  Jun 12, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 2.1.2.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Managed Cloud Core services and Consumption Billing.

Impact on Customers: No downtime and no impact on live customer solutions expected.


- Posted on Jun 12, 08:00 UTC

Completed: The upgrade has been successfully completed
- Posted on Jun 12, 09:21 UTC

In Progress: The planned upgrade has been started on production environment. 
- Posted on Jun 12, 08:00 UTC

Scheduled: This upgrade has been scheduled
- Posted on Jun 06, 06:49 UTC

  Jun 04, 2019

Sitecore Azure Marketplace Core services update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights: Updated the Self-signed certificates created from marketplace(api) to support identity server and commerce server


- Posted on Jun 03, 07:00 UTC

Completed: The upgrade has been successfully completed
- Posted on Jun 04, 10:52 UTC

In Progress: This upgrade in the form of release packages & product packages deployment is in progress.
- Posted on Jun 03, 06:33 UTC

Scheduled: This upgrade has been scheduled
- Posted on May 30, 12:28 UTC

  Jun 03, 2019

App Center - GeoIP Lookups Report - Data Missing for Recent Months

When viewing the App Center Reports for the IP Geolocation Service, the Lookups count for the last few months is reporting incorrectly as "zero".

Please note that all IP Geolocation Lookup data is still being recorded as expected in the internal database, and can be gathered if requested.

We are investigating the cause of this issue, and will provide updates when new information is available.


- Posted on May 23, 18:24 UTC

Resolved: 

The report discrepancies for the IP Geo Location Lookups count has now been corrected for all customers.

If any additional discrepancies are observed, please create a ticket in the Support Portal. (https://support.sitecore.net) or contact your sales rep.


- Posted on Jun 03, 14:00 UTC

Update: 

An analysis of the cause for the report discrepancies has been identified.  Work is underway to correct the issues for all records of IP Geo Location customers in this state.

Further updates will be provided once the corrections are made.


- Posted on May 27, 20:56 UTC

Identified: Reporting issues in the App Center UI have been identified for the IP Geolocation Service, and are under investigation.
- Posted on May 23, 18:32 UTC

  May 23, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 2.1.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Managed Cloud Core services and Consumption Billing.

Impact on Customers: No downtime and no impact on live customer solutions expected.


- Posted on May 23, 09:00 UTC

Completed: The upgrade has been successfully completed 
- Posted on May 23, 12:13 UTC

In Progress: The planned upgrade has been started on production environment.
- Posted on May 23, 09:00 UTC

Scheduled: This upgrade has been scheduled
- Posted on May 15, 09:01 UTC

  May 22, 2019

Azure Network Connectivity Errors - Multiple Sitecore Cloud Services in Europe

During Daily monitoring activities, Sitecore Cloud Engineers found an issue affecting multiple Microsoft Azure Services, which could have had an impact on Managed Cloud, xDB Cloud, Device Detection and IP Geolocation customers in all regions.

Affected Sitecore Cloud Service: Sitecore xDB Cloud and Managed Cloud customers

Customer identification: All xDB and Managed Cloud customers

Impact: The problem reported by Microsoft affects App Service, Azure Search, Logic Apps, Network Infrastructure, Network Watcher, Redis Cache; Storage, Virtual Network. This means that these services may not be reachable intermittently.

Impacted region: North Europe

Additional references: https://azure.microsoft.com/en-us/status/history/

Date identified: 07:50 AM UTC

Date resolved: 08:36 PM UTC

Planned further actions:  Azure Engineers are continuing to investigate & establish the full root cause. A full Root Cause Analysis should be updated as soon on the above Azure reference link.

Who performs further actions: Azure

Next update planned at: No further updates


- Posted on May 22, 07:50 UTC

Resolved: Microsoft engineers isolated the unhealthy device which was then restarted in order to re-establish connections.
- Posted on May 22, 08:36 UTC

Identified: 
- Posted on May 22, 00:00 UTC

  May 13, 2019

Azure Network Connectivity - Increased Latency

During Daily monitoring activities, Sitecore Cloud Engineers found an issue affecting multiple Microsoft Azure Resources, which could have had an impact on Managed Cloud and xDB Cloud customers in all regions. Customer might have experienced latency or intermittent connectivity issues when accessing Azure resources.

Affected Sitecore Cloud Service: Sitecore xDB Cloud and Managed Cloud customers

Customer identification: All xDB and Managed Cloud customers

Impact: The problem reported by Microsoft affects Azure Resources.

Additional references: https://azure.microsoft.com/en-us/status/history/

Sitecore engineers will closely follow up on the issue and post further updates under this event article on status page.


- Posted on May 13, 09:00 UTC

Resolved: Microsoft Azure Engineers have corrected the Networking issues causing the impact to Azure Resources.
- Posted on May 13, 15:00 UTC

Identified: Sitecore Cloud Operations Engineers have identified the issue and are currently working with Microsoft Support to get ETAs and plans of issue mitigation.
- Posted on May 13, 09:00 UTC

  May 12, 2019

Sitecore Email Cloud (Sparkpost) - Transition from Message Events API to Events API

During daily monitoring activities, Sitecore Cloud Operations engineers noticed an operational notice from the Email cloud vendor "Sparkpost" which communicates that the Message Events API will be replaced by the Events API

Affected Sitecore Cloud Service: Sitecore Email Cloud customers

Customer identification: Sitecore Email Cloud customers

Impact:  Starting on October 1, 2019, all the API calls made to Sparkpost must use the Events API. The Message Events API will be discontinued, and hence customers using the Message Events API will not be able to get the required data from Sparkpost.

Additional references:  The Events Search which is part of the Events API has robust searching capabilities that provide ready access to the raw event data associated with the messages that are sent via SparkPost.

In order to help the customers with the transition,  Sparkpost has also come up with a migration aid for node.js or python.


- Posted on Oct 01, 00:00 UTC

UPDATE: 

It has been confirmed that this update/change will NOT impact any of the Sitecore Email cloud customers.

And Sitecore Cloud Operations have taken necessary internal actions regarding this API change.

 


- Posted on May 12, 12:10 UTC

Identified: 
- Posted on May 09, 00:00 UTC

  May 07, 2019

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with an internal Release package 0.332, targeted for Sitecore Managed Cloud App Updates.

Those changes are focused on Managed Cloud App internal improvements , New fields in slot descriptions, bug fixes and new features for Sitecore Compliance.

Release Highlights:

  • Managed Cloud (MC) App: UI update - New fields in slot descriptions.
  • MC App (UI): Add new fields to slot descriptions.
  • MC App: Remove Obsolete Code.
  • Feature : Sitecore Compliance
  • MC App: Support all required Asterisk scenarios
  • MC App tweaks
  • Bug fix for “MC App: Asterisk is shown for complete months in consumption table UI”.
  • Bug fix for “Payment Cycle dropdown list retains values when there is no payment cycle for an agreement”.
  • Bug fix for “Total spend in the Provisioned Slot section is not reflecting the correct value”

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.

 

- Posted on May 06, 00:00 UTC

COMPLETED: The upgrade has been successfully completed.
- Posted on May 07, 20:53 UTC

IN PROGRESS: The planned upgrade has been started on production environment.
- Posted on May 07, 13:44 UTC

SCHEDULED: This upgrade has been scheduled.
- Posted on May 03, 22:47 UTC

Identified: 
- Posted on May 03, 00:00 UTC

  May 07, 2019

Issues of Azure SQL Databases in the West Europe region

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified an alert which we would like to bring to your attention.
Affected Sitecore Cloud Service: Sitecore Managed Cloud - Customer

Customer identification: The South Central US Managed Cloud Customers

Issue description: Starting at approximately 11:10 UTC, a subset of customers using SQL Database in West Europe may experience difficulties connecting to resources hosted in this region. Engineers are aware of this issue and are actively investigating. The next update will be provided in 60 minutes, or as events warrant.

Impact: Some customers may difficulties connecting to resources hosted in this region. 

Additional references:  https://azure.microsoft.com/en-us/status/history/

Date identified: 11:10 AM UTC

Date resolved: 12:48 PM UTC

Planned further actions:  Azure Engineers are continuing to investigate & establish the full root cause. A full Root Cause Analysis should be updated as soon on the above Azure reference link.

Who performs further actions: Azure

Next update planned at: No further updates


- Posted on May 07, 11:10 UTC

Resolved: Microsoft Azure Engineers have corrected the issues causing the impact to Azure SQL databases in the West Europe region. 
- Posted on May 07, 12:48 UTC

Identified: Sitecore Cloud Operations Engineers have identified the issue and are currently working with Microsoft Support to get ETAs and plans of issue mitigation. 
- Posted on May 07, 11:10 UTC

  May 02, 2019

Azure Network Connectivity Errors - Multiple Sitecore Cloud Services

During Daily monitoring activities, Sitecore Cloud Engineers found an issue affecting multiple Microsoft Azure Services, which could have had an impact on Managed Cloud and xDB Cloud customers in all regions.

Affected Sitecore Cloud Service: Sitecore xDB Cloud and Managed Cloud customers


Customer identification:
All xDB and Managed Cloud customers


Impact:
The problem reported by Microsoft affects Azure SQL databases, Compute, Storage, App Service, and Azure Active Directory. This means that these services may not be reachable intermittently.  

Additional references: https://azure.microsoft.com/en-us/status/history/

Sitecore engineers will closely follow up on the issue and post further updates under this event article on status page.


- Posted on May 02, 19:43 UTC

Resolved: Microsoft Azure Engineers have corrected the Networking issues causing the impact to Azure Services.
- Posted on May 02, 22:53 UTC

Identified: Sitecore Cloud Operations Engineers have identified the issue and are currently working with Microsoft Support to get ETAs and plans of issue mitigation.
- Posted on May 02, 19:43 UTC

  Apr 23, 2019

Sitecore Azure Marketplace New Commerce Storefront package

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

 

  • Commerce 9.1 Initial Release for Sitecore 9.1 Update-1
  • Storefront 2.0 Initial Release for Sitecore 9.1 Update-1

- Posted on Apr 22, 18:24 UTC

COMPLETED: 

Production deployment of the new product packages have been completed successfully for both the SouthEast Asia & Central US regions.


- Posted on Apr 23, 10:28 UTC

STARTED: The deployment of the product packages of Commerce & Storefront for Sitecore 9.1 Update-1 are in progress on the production Azure marketplace environment.
- Posted on Apr 22, 19:37 UTC

Identified: 
- Posted on Apr 22, 00:00 UTC

  Apr 17, 2019

xDB Cloud Customers Maintenance

Sitecore Cloud Operations team is performing security updates on customer's resources. No impact on all existing customers expected.


- Posted on Apr 10, 12:00 UTC

Completed: Maintenance has been finished.
- Posted on Apr 17, 15:08 UTC

In Progress: Maintenance is in progress. Still, no impact expected.
- Posted on Apr 14, 09:03 UTC

Started: Maintenance has been started. No impact expected.
- Posted on Apr 10, 12:00 UTC

  Apr 16, 2019

IP Geolocation and Device Detection core service update

Sitecore Cloud Operations team is performing IP Geolocation and Device Detection core service update. No impact on all existing customers expected.


- Posted on Apr 15, 07:48 UTC

Completed: IP Geolocation and Device Detection core service update have been completed successfully.
- Posted on Apr 16, 07:40 UTC

Started: Update has been started. No impact expected. 
- Posted on Apr 15, 07:55 UTC

  Apr 11, 2019

Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 2.0.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Sitecore Managed Cloud Core service.

Expected impact on customers: No downtime and no impact on live customer solutions expected.

 

- Posted on Apr 11, 09:00 UTC

Completed: Consumption Rest API update is completed
- Posted on Apr 11, 13:43 UTC

In Progress: This upgrade in the form of release packages & product packages deployment is in progress 
- Posted on Apr 11, 08:37 UTC

Started: The upgrade has been started 
- Posted on Apr 11, 08:30 UTC

Scheduled: This upgrade has been scheduled
- Posted on Apr 09, 15:16 UTC

  Apr 05, 2019

Sitecore Azure Marketplace Core services update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure with new release packages & product packages.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Sitecore 9.1.1 with modules
    • JSS 11.0.1
    • SXA 1.8.1
    • CDN 1.0.0
    • Salesforce 1.0.0
  • SXA Compatibility update
    • Sitecore 9.0.2 supports SXA 1.8.1 instead SXA 1.8.0
  • Marketplace Prod/NonProd settings implemented
  • Self-sign certificate creation updated to use .Net 4.7.2

- Posted on Apr 04, 07:00 UTC

COMPLETED: The upgrade of the Azure Marketplace for the Sitecore Experience cloud product by way of deploying the latest release packages & product packages has been completed successfully.
- Posted on Apr 05, 11:38 UTC

IN PROGRESS: This upgrade in the form of release packages & product packages deployment is in progress
- Posted on Apr 04, 12:31 UTC

STARTED: The upgrade has been started.
- Posted on Apr 04, 12:29 UTC

Identified: 
- Posted on Apr 04, 00:00 UTC

  Apr 05, 2019

Some xDB sets may not work

During monitoring Sitecore Cloud Operations team has detected that some xDB Cloud sets may not work as expected. Some Customers may get errors while connecting to Reporting service and as a results Analytics reports may not show the latest data or show errors.


- Posted on Apr 02, 00:00 UTC

Resolved: Issue has been resolved, all xDB sets are back to normal state, Analytics reports temporary may not show the latest data.
- Posted on Apr 05, 11:37 UTC

Identified: We have identified the root cause of the issue and working on restoring the service back to normal state.
- Posted on Apr 04, 00:00 UTC

  Mar 31, 2019

Sitecore Package Management Service - Redeployment

As part of a regular maintenance process, a new version of the Sitecore Package Management Service for the Update Center will be deployed. Please see the following links regarding the details for this new version: Package Management Service and the Sitecore Update Center.

During the maintenance period, the Package Management Service will be unavailable.


- Posted on Mar 31, 15:30 UTC

Finished: All maintenance activities are complete.
- Posted on Mar 31, 17:21 UTC

Started: The maintenance period begins.
- Posted on Mar 31, 15:30 UTC

  Mar 28, 2019

Status Page - Infrastructure Update

During month of March, Sitecore Cloud Operations was performing a migration of Status Page application to the new infrastructure. As a result, Status Page is now utilizing scaled infrastructure for better scalability and reliability. Over the maintenance timeframe, Status Page was not available permanently.
- Posted on Mar 06, 12:00 UTC

Finished: All maintenance activities are finished
- Posted on Mar 28, 16:22 UTC

Started: The maintenance period begins
- Posted on Mar 06, 10:00 UTC

  Mar 25, 2019

Sitecore Email Cloud increase in errors on outbound

We are seeing an increase in "delays"/4xx errors on outbound message delivery for some Sitecore Email Cloud Customers.
- Posted on Mar 25, 15:00 UTC

Resolved: 

This incident has been resolved. For further information please review the following Link.

https://status.sparkpost.com/incidents/xhywqb7cfbkc


- Posted on Mar 25, 15:30 UTC

Identified: The issue has been identified and a fix is being implemented.
- Posted on Mar 25, 15:00 UTC

  Feb 22, 2019

Azure Intermittent Network Related Timeout for xDB Cloud

During daily monitoring activities, Sitecore Cloud Operations engineers found an issue with Microsoft Azure .

Root cause and mitigation: The Azure Service Management layer (ASM), that manages Classic VMs and Classic Cloud Services, is composed of multiple services and components. During this event, ASM Front ends were running low on available resources, causing some incoming requests to timeout. Engineers established that a platform service update introduced this regression that surfaced only at high incoming traffic volume. The ASM update went through the standard extensive testing and the fault did not manifest itself when the update transited through first, the pre-production environments, and later through the first Production slice where it baked for multiple days. There was no indication of such a failure in those environments during this time.

As a mitigation, the Front Ends were scaled out which restored the service health


- Posted on Feb 22, 07:00 UTC

Resolved: 

As a mitigation, the Front Ends were scaled out which restored the service health.

For further details please review the following link.

https://azure.microsoft.com/en-us/status/history/


- Posted on Feb 22, 11:37 UTC

Identified: As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified an issue with Microsoft Azure
- Posted on Feb 22, 07:00 UTC

  Feb 20, 2019

Email Cloud Scheduled Maintenance

We are performing maintenance on the Metrics API and the Message Events API starting on Wednesday, February 20 at 10am Eastern and continuing until 10am Eastern on Thursday, February 21. During this maintenance period, some customers may experience an increase in latencies when calling the Metrics API and elevated levels of timeouts. The increased latency will also effect the loading times of the Reports section of the SparkPost application. There will be no effect on your data which will appear as normal when the maintenance period is completed. Message injection and outbound message delivery will not be impacted - all messages will flow through as expected.
- Posted on Feb 20, 10:00 UTC

Completed: The scheduled maintenance is now finished.
- Posted on Feb 20, 16:30 UTC

Identified: Scheduled maintenance is Planned for Sparkpost Service.
- Posted on Feb 20, 00:00 UTC

  Feb 19, 2019

Deployment Internal Consumption Service update

Sitecore Cloud Operations team is preparing the following planned release to Sitecore Cloud Services.

 

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.
- Posted on Mar 19, 10:00 UTC

COMPLETED: Production deployment has been completed successfully , including the post deploy validations.

This upgrade has been completed successfully.
- Posted on Feb 19, 17:00 UTC

Identified: This upgrade has been scheduled. 
- Posted on Feb 19, 00:00 UTC

  Feb 04, 2019

Sitecore App Source Customer Instance VM Maintenance

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified will perform Maintenance.
- Posted on Feb 04, 09:00 UTC

COMPLETED: The scheduled maintenance is now finished. 
- Posted on Feb 04, 16:00 UTC

Identified: This planned maintenance has been identified.
- Posted on Feb 04, 00:00 UTC

  Jan 31, 2019

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 1.7.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Sitecore Managed Cloud Core service.

Expected impact on customers: No downtime and no impact on live customer solutions expected.



- Posted on Jan 14, 13:00 UTC

Resolved: This upgrade has been successfully performed on production.
- Posted on Jan 31, 15:31 UTC

Scheduled: This upgrade has been scheduled.
- Posted on Jan 09, 10:30 UTC

  Jan 08, 2019

AppCenter connection Problem

Some users may experience problems while accessing AppCenter from Sitecore Control Panel. Sitecore team is already looking into the issue.
- Posted on Jan 08, 16:00 UTC

Resolved: Service is up and running. Users should be able to login to AppCenter.
- Posted on Jan 08, 18:50 UTC

Identified: AppCenter users are not able to login or view any data.
- Posted on Jan 08, 00:00 UTC

  Jan 08, 2019

Sitecore Azure Marketplace Infrastructure Product Package Deployment

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Fixed deployment error when using Solr as Search Service with the unsupported location of Azure Search ( For example, "Canada East").
  • Changes involve the deploy of updated ARM templates for this release.

- Posted on Jan 07, 20:02 UTC

COMPLETED: 

Production deployment has been completed successfully , including the post deploy validations.

This upgrade has been completed successfully.


- Posted on Jan 08, 09:50 UTC

IN PROGRESS: This upgrade has now been started & is in progress.
- Posted on Jan 08, 07:13 UTC

SCHEDULED: This upgrade has been scheduled.
- Posted on Jan 07, 20:48 UTC

Identified: 
- Posted on Jan 07, 00:00 UTC

  Dec 20, 2018

Sitecore App Center Managed Cloud App Hotfix

Sitecore Cloud Operations team will  deploy the hotfix which resolved the reported issues.This hotfix addresses the fix for the issue where a customer is not able to view any consumption Data on Managed Cloud App in App Center.

Impact on Customers: No downtime and no impact on live customer solutions expected.


- Posted on Dec 20, 14:30 UTC

Completed: This Hotfix deployment has been successfully performed on production service
- Posted on Dec 20, 14:35 UTC

Started: This Hotfix deployment has been started on production service.
- Posted on Dec 20, 14:30 UTC

Identified: 
- Posted on Dec 19, 00:00 UTC

  Dec 13, 2018

Sitecore Email Cloud Connector Maintenance

Sitecore Cloud Operations team will perform maintenance on Sitecore Email Cloud Connector Service.

 

No impact expected on customers using Email Cloud Service.


- Posted on Dec 13, 11:00 UTC

Completed: This maintenance has been successfully performed on production service
- Posted on Dec 13, 12:03 UTC

Started: This maintenance has been started on production service. 
- Posted on Dec 13, 11:00 UTC

Identified: Planned service maintenance window for Email Cloud Connector Service.
- Posted on Dec 10, 00:00 UTC

  Dec 06, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to the existing Sitecore Customer's Cloud resources.

Release Highlights:

  • Commerce 9.0 Update-3 for Sitecore 9.0 Update-2
  • Storefront 1.0 Update-3 for Sitecore 9.0 Update-2
  • SPA bug fixes
    • SAS token for arm modules parameters is not same as module arm template link SAS token
    • Certificate control bundle fields does not validate CommonName and Password field

- Posted on Dec 06, 00:30 UTC

COMPLETED: This upgrade has been successfully performed on production
- Posted on Dec 06, 13:45 UTC

IN PROGRESS: Production upgrade using latest product release packages is in progress.
- Posted on Dec 06, 01:18 UTC

STARTED: The deployment on to the production environment has been started
- Posted on Dec 06, 00:52 UTC

Identified: 
- Posted on Dec 05, 00:00 UTC

  Dec 04, 2018

Intermittent Network Degradation - South Central US

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified an alert which we would like to bring to your attention.

Affected Sitecore Cloud Service: Sitecore Managed Cloud - Customer

Customer identification: The South Central US Managed Cloud Customers

Issue description: As per Azure communication, the South Central US Managed Cloud Customers might have experienced degraded performance, network drops or time outs when accessing Azure resources hosted in this region. Applications and resources that retried connections or requests may have succeeded due to multiple redundant network devices and routes available within Azure data centers.

Impact: Degraded Performance, network drops or time outs when accessing Azure resources in the South Central US Data Center.

Additional references:  https://azure.microsoft.com/en-us/status/history/

Date identified: Between 02:48 UTC and 04:52 UTC on 04 Dec 2018

Date resolved: 04 Dec 2018 at 04:52 UTC 

Planned further actions: Azure Engineers are continuing to investigate & establish the full root cause. A full Root Cause Analysis should be updated in approximately 72 hours on the above Azure reference link.

Who performs further actions: Azure

Next update planned at: No further updates


- Posted on Dec 04, 02:48 UTC

RESOLVED: As per Azure, this issue is now resolved.
- Posted on Dec 04, 06:35 UTC

Identified: 
- Posted on Dec 04, 00:00 UTC

  Nov 29, 2018

Elevated 5xx errors and latency increase for Email Cloud Sparkpost US customers

Sparkpost reported an elevated level of API errors and latency APIs for some US customers on 28 Nov 2018 20:30 - 21:44 UTC.
If you got any errors while sending emails during issue time-frame, please try again.
Note: This issue does not impact our Sparkpost Enterprise customers hosted in the EU.

More details on Sparkpost status page: https://status.sparkpost.com/incidents/h27bwxyy4gy2


- Posted on Nov 28, 20:30 UTC

Resolved: Sparkpost reported that issue was resolved on 28 Nov 2018 21:44 UTC
- Posted on Nov 29, 02:40 UTC

  Nov 27, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: 
No impact to existing Sitecore Customer's Cloud resources.

Release Highlights:

  • New Sitecore release  with modules:
    • CDN 1.0.0
    • JSS 11.0.0
    • SXA 1.8.0
    • Salesforce 1.0.0
  • SXA Compatibility update:
    • Sitecore 9.0.2 supports SXA 1.8 instead 1.7.1
  • An Option added to Marketplace to switch On/Off Application Insight in the Sitecore 9.1.0 deployment
  • An new option added to Marketplace to provision CDN as a part of the Sitecore deployment or Customer use their existing CDN
  • Added "patches" arm templates folder support in Storage API Upload Endpoint

- Posted on Nov 26, 09:00 UTC

FINISHED: The update has been completed successfully.
- Posted on Nov 27, 13:27 UTC

STARTED: The Core service update has been started.
- Posted on Nov 26, 09:00 UTC

  Nov 20, 2018

AppCenter connection problems

Some users may experience problems while accessing AppCenter from Sitecore Control Panel. Sitecore team is already looking into the issue.


- Posted on Nov 20, 03:00 UTC

Resolved: 

One of our underline subsystems has failed which led to AppCenter connection issues.

Right now all systems are back to normal state and AppCenter is operating normally.

All customers should be able to access AppCenter now.


- Posted on Nov 20, 08:58 UTC

Identified: AppCenter users are not able to login or view any data.
- Posted on Nov 20, 03:49 UTC

  Nov 13, 2018

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 1.6.0.0 to Sitecore Managed Cloud Services.

Affected Sitecore Cloud Service: Managed Cloud Core services and Consumption Billing.

Impact on Customers: No downtime and no impact on live customer solutions expected.

Release summary:   

Bug 249706

PBI 229838

PBI 206473

PBI 161233


- Posted on Nov 12, 13:30 UTC

FINISHED: The Update has been finished successfully.
- Posted on Nov 13, 13:41 UTC

STARTED: The update has been started.
- Posted on Nov 12, 13:30 UTC

  Nov 12, 2018

Sitecore App Center - Planned Upgrade with New Features & Bug fixes

Release summary:

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.329, 0.333, 0.3331  along with some New features & Bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore Managed Cloud.

  • Removing dependency on Silverlight – Impersonate Management User into SPEAK.
  • Support download of consumption details in Managed Cloud.

Impact on Customers:    No impact on live customer solutions expected.


- Posted on Nov 12, 13:00 UTC

Finished: The Update has been completed successfully.
- Posted on Nov 12, 15:33 UTC

Identified: 
- Posted on Nov 08, 00:00 UTC

  Nov 08, 2018

Sitecore Managed Cloud Subscriptions Update

Updating Azure Subscriptions setup for all Managed Cloud customers to comply with latest update to Access Policy published here: https://kb.sitecore.net/articles/133931. No impact and no service interruptions are expected.


- Posted on Nov 29, 14:00 UTC

Identified: 

Access Policy published here: https://kb.sitecore.net/articles/133931.


- Posted on Nov 08, 00:00 UTC

  Oct 31, 2018

181026 App Center - Internal Dependent System Update

An internal dependent system related to the App Center requires an update.  There is a possibility that the App Center could be affected by this update.  However, we don't expect that the update will have any impact on App Center customers.
- Posted on Oct 28, 01:00 UTC

Resolved: 

Sitecore Cloud Operations team were able to deploy the hotfix which resolved the reported issues.Post deployment validations and smoke tests passed successfully.


- Posted on Oct 31, 13:47 UTC

Update: 

Sitecore Cloud Operations team have Identified issues which will prevent customers from logging in to The Sitecore App Center UI. The reported issues will not prevent customers from using the other services.


- Posted on Oct 29, 13:53 UTC

Identified: We have been alerted that this system update will take place on 28-Oct-2018 from 01:00 am to 01:00 pm UTC.
- Posted on Oct 26, 17:04 UTC

  Oct 30, 2018

Scheduled Maintenance for Status Page

 Sitecore Cloud Status page will be down for 2 hours for scheduled maintenance starting at 2018-11-06 22:00:00 UTC. During this time, the following instances will be unavailable.

We perform maintenance regularly to ensure the service runs stably and securely for our customers.


- Posted on Nov 06, 22:00 UTC

Identified: We have been alerted that this system update will take place on 2018-11-06 22:00:00 UTC. Status Page will be unavailable During maintenance period. 
- Posted on Oct 30, 00:00 UTC

  Oct 25, 2018

xDB Cloud resource connectivity issues in West US

Beginning at approximately 22:40 UTC on 24 Oct 2018, xDB Cloud customers in West US may have experienced issues connecting to their Azure and MongoDB resources.
- Posted on Oct 24, 22:40 UTC

Resolved: 

As of 00:03 UTC 24-Oct-2018, Azure engineers have restored the affected services.

For additional root cause information, please see the Azure status page.


- Posted on Oct 25, 00:03 UTC

Identified: 
- Posted on Oct 25, 00:00 UTC

In Progress: 

Azure engineers are working to resolve the issues with the West US resources.

Please see updates here: Azure Status page


- Posted on Oct 24, 23:30 UTC

  Oct 22, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on the Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: 
No impact to existing Sitecore Customer's Cloud resources.

Release Highlights:

  • UI Fixes on Summary Page for selected modules
  • Fixed modules list when all modules is not selected
  • Fixed Additional Deployment Inclusion Control Bundle does not reflect on arm response
  • Fixed Certificate Control Bundle, download link return ByteArray content instead of Base64 content

 


- Posted on Oct 19, 10:00 UTC

COMPLETED: 

The release packages for the Market place core services upgrade have been successfully deployed  on the production infrastructure.

All the post deploy validations have also passed.


- Posted on Oct 22, 22:02 UTC

IN PROGRESS: The deployment of new release packages for upgrade is in progress on production infrastructure.
- Posted on Oct 22, 21:40 UTC

STARTED: The upgrade has now been started on production marketplace.
- Posted on Oct 22, 21:38 UTC

SCHEDULED: This upgrade has now been scheduled for deployment.
- Posted on Oct 19, 10:07 UTC

Identified: 
- Posted on Oct 19, 00:00 UTC

  Oct 22, 2018

xDB Cloud Core Services Release 2.0.2.9 Update

Sitecore Cloud Operations team is preparing the following planned Release 2.0.2.9 to xDB Cloud Core Services.

Impact on Customers: No downtime and no impact on live customer solutions expected.


Release summary: Internal improvements and fix bugs. 
- Posted on Oct 19, 09:30 UTC

Finished: The Update has been completed successfully. 
- Posted on Oct 22, 07:00 UTC

Update: The update has been started.
- Posted on Oct 19, 00:00 UTC

  Oct 04, 2018

Sitecore Appsource Test Drive failing

Issue Description:

The ability to spin up Sitecore XP Test Drive instances through Sitecore Appsource  is currently stalled.

Unable to spin up the Sitecore XP Test Drive instances (8.2.4) through the Sitecore App source.

Impact on End Users:

Although the users may submit the request for Test Drive instances , it fails after sometime stating that App source is experiencing problems & hence to try later.

This failure is due to failing deployments of the Sitecore XP on Azure.

The deployments are failing because,  one of the Site Extension(Sitecore.AppSource.SiteExtension) we are using in AppSource deployment is no longer available

 

Exact Sitecore version:  Sitecore XP Test Drive instances (8.2.4)

Planned further actions:

Sitecore is working actively to migrate & then configure the Sitecore.AppSource.SiteExtension to nuget.org  and make it available to the Azure Test Drive App source engine during deployments.

 

Next update planned at:

Cloud Operations will provide an update to this status page item , once the issue has been resolved & verified that the Sitecore XP Test Drive instances can be spun again successfully from App source.


- Posted on Sep 17, 01:00 UTC

RESOLVED: This issue has now been resolved & we have verified that the Sitecore XP Test Drive requests are now successful through AppSource.
- Posted on Oct 04, 06:46 UTC

Identified: 
- Posted on Sep 30, 00:00 UTC

IN PROGRESS: Sitecore is working actively to migrate & then configure the Sitecore.AppSource.SiteExtension to nuget.org  and make it available to the Azure Test Drive App source engine during deployments.
- Posted on Sep 26, 13:00 UTC

Identified: Sitecore  XP Test Drive failing through Appsource
- Posted on Sep 17, 01:00 UTC

  Oct 03, 2018

Sitecore App Center - Planned Upgrade with New Features & Bug fixes

Release summary:

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.324, 0.325, 0.326, 0.327, 0.328 along with some New features & Bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore Email Cloud, Sitecore Managed Cloud.

  • Managed Cloud App updates to support past period consumption and display account name in page header.
  • Fixed Manage Cloud App bugs.
  • App center Login: Remove requirements for fields in CRM Account.
  • One Bug fixed include :  Managed Cloud UI App breaks up when Slot has no Metric instances.
  • One of the many bugs fixed include : Managed Cloud Consumption App Not Visible to Customers.

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.


- Posted on Sep 30, 15:00 UTC

COMPLETED: 

The production app center servers are now successfully updated with these release packages.

All the relevant post deploy validations & various smoke tests have passed positively.


- Posted on Oct 03, 10:01 UTC

IN PROGRESS: The Sitecore App center upgrade process through deployment of the new release packages has been started.
- Posted on Oct 01, 14:03 UTC

Scheduled: Upgrade has been scheduled.
- Posted on Sep 30, 12:35 UTC

Identified: 
- Posted on Sep 30, 00:00 UTC

  Oct 01, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: 
No impact to existing Sitecore Customer's Cloud resources.

Release Highlights:

·         Enable TLS 1.2 for Sitecore 8.2.x line

·         Set Marketplace API to TLS min version as 1.0

·         Update Marketplace assemblies and package versions to 2.x.x

 


- Posted on Oct 02, 00:30 UTC

Update: The update has been started.
- Posted on Oct 01, 12:54 UTC

Update: 

The update put on-hold till the next week.


- Posted on Sep 26, 00:00 UTC

  Sep 24, 2018

Email Cloud Sparkpost Errors

Some Email Cloud customers may experience 5xx errors during email injections

Sitecore team have identified the root case of the issue. We are working on identifying the full impact. 


- Posted on Sep 24, 11:30 UTC

Resolved: The issue has been resolved. 
- Posted on Sep 24, 12:30 UTC

Identified: Sitecore team have identified  issues with the Email Cloud Service.
- Posted on Sep 24, 11:30 UTC

  Sep 07, 2018

Managed Cloud - Azure South Central US location multiple services connection problems

Azure reported that starting from 09:26 UTC 04 Sep 2018 multiple services in South Central US region may be inaccessible, more details on https://azure.microsoft.com/en-us/status/

Managed Cloud customers may experience problems while accessing resources in Azure Portal, also all Azure resources like Web Apps, SQL databases, storage etc. and Mongo databases connection may fail by timeout for the South Central US region.

xDB Cloud 1.0 customers may also experience connection problems from multiple locations.

Sitecore team will keep monitoring and updating the status.


- Posted on Sep 04, 09:26 UTC

Resolved: Azure reported that all services are now restored.
- Posted on Sep 07, 11:13 UTC

Mitigated: 

Azure engineers report that most of the services have been restored. All Managed Cloud and xDB Cloud customers shouldn't have any issues, however Azure engineers haven't yet restored Storage services in South Central US.


- Posted on Sep 06, 11:49 UTC

Azure engineering status update: 

Azure Engineers have restored storage availability for the majority of impacted services, and customers should be continuing to see improvements to service availability.

Azure Engineers are continuing to work on any residual storage impact to fully mitigate this issue.



- Posted on Sep 05, 13:00 UTC

Azure engineering status: Azure Engineers are prioritizing the restoration of Storage resources in order to recover all services with dependencies on these impacted resources.  As storage mitigation continues to progress, a necessary extended mitigation phase is required. 

- Posted on Sep 05, 11:06 UTC

Update: Azure Support Engineers continue to focus on the restoration of Storage-related resources as a majority of services still impacted are dependent on this service.

The next update will be provided by 11:00 UTC 05 Sep 2018 or as events warrant.
- Posted on Sep 05, 06:37 UTC

In Progress: Sitecore team have identified that xDB Cloud 1.0 customers may also experience connection timeouts. We are working on identifying the full impact.
- Posted on Sep 04, 14:10 UTC

Identified: Azure support has identified the root cause which was in a localized cooling system failure and working on the solution.
- Posted on Sep 04, 13:41 UTC

  Sep 04, 2018

Sitecore Managed Cloud - Azure App Service upgrade to .NET Framework 4.7.2

Sitecore Cloud Operations team brings to your notice the below Planned Azure App services upgrade:

Affected Sitecore Cloud Service: Sitecore Managed Cloud (Any Topology).

Maintenance Upgrade Summary: 

We have received notifications from Microsoft that they will be rolling out .NET 4.7.2 across all Azure App Service instances in September, 2018, this is not an optional rollout. 
The Azure app service apps for the Sitecore Managed cloud environments will be upgraded to the .NET Framework 4.7.2 update.
Since the release is backwards compatible any existing Sitecore instances should be free from issues. 
We have reviewed the Release Notes - there are no breaking changes for applications targeting previous versions (4.5, 4.6, 4.7.1) and since Sitecore explicitly includes target framework in the httpRuntime/targetFramework attribute, and is compiled for previous versions of .NET Framework, there shouldn’t be any change to our services. 

Expected impact on customers: 

As per Azure , there should not be any service interruptions associated with this update for the various Sitecore Managed Cloud environments.
However, this status update will serve as a heads up notification , since the upgrade will be performed on the Sitecore Managed Cloud Azure App Services.

When ? :  Update scheduled throughout the month of SEP-2018.

Release details:

Please refer to below for complete details about this release:

1) .NET Framework 4.7.2 release announcement

2) https://github.com/Azure/app-service-announcements/issues/89 

3) https://blogs.msdn.microsoft.com/dotnet/2018/04/30/announcing-the-net-framework-4-7-2/ 


- Posted on Sep 01, 00:30 UTC

In Progress: This upgrade will be in progress throughout the month of September - 2018
- Posted on Sep 04, 21:12 UTC

Identified: 
- Posted on Sep 04, 00:00 UTC

  Aug 31, 2018

Email Cloud Sparkpost SMTP API errors and latency

Some customers may experience 5xx errors and increased latency during email injections. Please retry later any 5xx error.

Note: Customers who use Sparkpost EU are not affected.

More details on Sparkpost status page: https://status.sparkpost.com/
- Posted on Aug 31, 20:53 UTC

Resolved: The issue has been resolved.
- Posted on Aug 31, 23:31 UTC

Identified: 
- Posted on Aug 31, 00:00 UTC

  Aug 21, 2018

Email Cloud Sparkpost SMTP API errors and latency

Some customers may experience 5xx errors and increased latency during email injections. Please retry later any 5xx error.

Note: Customers who use Sparkpost EU are not affected.

More details on Sparkpost status page: https://status.sparkpost.com/


- Posted on Aug 21, 11:30 UTC

Resolved: The incident has been resolved.
- Posted on Aug 21, 13:23 UTC

Identified: Incident has been identified.
- Posted on Aug 21, 11:30 UTC

Identified: 
- Posted on Aug 21, 00:00 UTC

  Aug 20, 2018

App Center - Delays regarding access requests to App Center

Due to update process in the internal system, requests regarding access to App Center (e.g. to activate IP Geolocation or to access Managed Cloud Consumption App) might be processed with delays. We are working on our side to overcome all the delays in the most efficient manner.
- Posted on Jul 17, 01:00 UTC

Resolved: All potential delays have been mitigated internally, so system is back into regular operations
- Posted on Aug 20, 01:00 UTC

Identified: The maintenance entry has been created
- Posted on Jul 17, 01:00 UTC

  Aug 15, 2018

Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.

Affected Sitecore Cloud Service: Sitecore Azure Marketplace.

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release Highlights

·        Commerce 9.0.2 Release (currently available with Azure Search provider only).

·        Storefront 1.0.2 Release.


- Posted on Aug 14, 12:00 UTC

Finished: The update has been completed.
- Posted on Aug 15, 07:36 UTC

Update: The update has been started.
- Posted on Aug 14, 00:00 UTC

  Aug 06, 2018

Sitecore Email Cloud - Subscription Error

Customers using EXM  might get an error alert"An error occurred " when they Open the subscription tab Under Administrator on EXM.

In the Logs, you might find the following exception  “The model backing the 'FrameworkDbModel' context has changed since the database was created.”

We have identified the root cause of the issue and we are working on the resolving the issue.


- Posted on Aug 03, 00:00 UTC

MITIGATED: This issue has been successfully mitigated.
- Posted on Aug 06, 14:19 UTC

Identified: Exception was Identified  “The model backing the 'FrameworkDbModel' context has changed since the database was created.”
- Posted on Aug 03, 00:00 UTC

  Aug 03, 2018

xDB Cloud Core services upgrade

Sitecore Cloud Operations team is preparing a planned upgrade of xDB Cloud Core services.

No impact on customers expected.


- Posted on Aug 03, 09:00 UTC

UPDATE: The upgrade has been completed successfully.
- Posted on Aug 03, 11:51 UTC

Identified: The upgrade has been started.
- Posted on Aug 03, 00:00 UTC

  Aug 02, 2018

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.318.0, 0.319.0.321,0.322 &  0.323.0 along with some bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore App center SPEAK UI , Sitecore Managed Cloud and Sitecore IP Geolocation offering.

Release Notes:

  • Release 0.318.0: Framework 4.0.1702,Framework.Items 4.0.1702, Framework.Api 4.0.1702
  • Release 0.319.0: Sitecore.Apps.ManagedCloud 1.0.451
  • Release 0.321.0: Sitecore.Apps.IP Geolocation 3.0.23
  • Release 0.323.0: Sitecore.EmailCloud 3.0.279
  • Various updates for improved Sitecore internal applications

Impact on customers during deployment: No customers impact is expected, App Center services will be restarted after the Deployment.


- Posted on Aug 02, 09:00 UTC

Finished: This planned update has been completed successfully
- Posted on Aug 02, 11:15 UTC

Identified: Maintenance Window is required for Sitecore App Center Updates with Bug fixes
- Posted on Jul 31, 09:00 UTC

  Jul 27, 2018

Multiple Sitecore Cloud Services Failures

Between 22:15 on 26 July 2018 and 06:20 UTC on 27 July 2018 our Sitecore Managed Cloud, xDB Cloud, Email Cloud and Geo IP customers could have experienced timeouts or an outage while using these services. List of impacted resources: Azure SQL Databases, Azure Storage, Azure Search, Azure Active Directory B2C, Azure Cloud Service, Azure App Service. Right now the incident has been resolved.
- Posted on Jul 26, 22:30 UTC

Identified: The Sitecore Cloud team identified the issue during monitoring. Azure confirmed the outage, more details on the Azure status page: https://azure.microsoft.com/en-us/status/history/. Our team is working on impact identification and mitigation plan.
- Posted on Jul 27, 10:00 UTC

  Jul 26, 2018

Email Delivery Service retired TLS v1.0

On 23 July 2018, SparkPost deprecated TLS v1.0. This caused because of Email Delivery Service unavailability for Sitecore solutions running on .NET Framework 4.5.2.

 


- Posted on Jul 23, 02:30 UTC

SOLUTION: The issue description with a solution details is available at  https://kb.sitecore.net/articles/941637
- Posted on Jul 26, 00:00 UTC

  Jul 25, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service: Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources. However, during the data upload of the new web deploy packages, new Sitecore Experience Cloud instances cannot be deployed using Azure Marketplace.

 

Release summary:

·         Enable SXA 1.7.1 for Sitecore 8.2 Update-7 Developer configuration

·         Enable SXA 1.7.1 for Sitecore 9.0 Update-2 Developer configuration

·         Update EXM DDS user interface


- Posted on Jul 24, 14:00 UTC

Finished: This planned update has been completed successfully.
- Posted on Jul 25, 09:13 UTC

Update: This Marketplace upgrade is in progress.
- Posted on Jul 24, 00:00 UTC

  Jul 16, 2018

Sitecore Azure Cloud resources down in West US and West Central US

Starting 16:00 UTC, our Sitecore Managed Cloud, xDB Cloud, Email Cloud and Geo IP customers in West US, West Central US and Australia East may experience an outage with their solutions. Resources directly impacted: Azure App Service, Azure SQL Databases, Azure Storage. Our team is validating exact impact and the mitigation plan. Further updates will be posted there.

 


- Posted on Jul 16, 16:00 UTC

Mitigated: 

As per the latest Azure status, this issue has been successfully mitigated.

Source : https://azure.microsoft.com/en-us/status/history/ 


- Posted on Jul 16, 18:15 UTC

Identified: The issue has been identified by the monitoring alerts on particular Web Apps in the affected region. Azure monitoring confirms the outage: https://azure.microsoft.com/en-us/status/. Our team is working on impact identification and mitigation plan.
- Posted on Jul 16, 16:00 UTC

  Jul 13, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources. However, during the data upload of the new web deploy packages, new Sitecore Experience Cloud instances cannot be deployed using Azure Marketplace.

Release summary:

1) Enable SXA 1.7.1 for Sitecore 8.2 Update-7  
2) Enable Solr as Search Provider for Sitecore 8.2 Update-7
3) Azure Search Replica Count Parameterization for Sitecore 8.2 Update-7
4) Salesforce 1.0 Initial Release for Sitecore 9.0 Release, 9.0 Update-1, and 9.0 Update-2
5) Removed SXA 1.7.1 xPSingle and xMSingle in Sitecore 9.0 Update-2
6) SPA bug fixes - 
o Region tab location dropdown is not persisted
o Azure Portal 'OK' Button is not enabled when navigate through tabs
o Speak package dependencies set to specific version 

 

- Posted on Jul 12, 06:00 UTC

COMPLETED: This maintenance upgrade has been successfully completed on Azure Marketplace.
- Posted on Jul 13, 05:52 UTC

IN PROGRESS: This Marketplace upgrade is in progress.
- Posted on Jul 12, 09:39 UTC

STARTED: This upgrade has been started.
- Posted on Jul 12, 08:35 UTC

Identified: 
- Posted on Jul 12, 00:00 UTC

  Jul 04, 2018

Deployment - API Management services for Sitecore Email Cloud Connector

Sitecore Cloud Operations team has started a deployment of API Management services for Sitecore Email Cloud Connector. 

Affected Sitecore Cloud Service:  Sitecore Email Cloud

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.


- Posted on Jul 03, 00:00 UTC

Completed: This planned deployment has been completed successfully.
- Posted on Jul 04, 17:59 UTC

Started: Planned deployment has been started
- Posted on Jul 03, 08:30 UTC

  Jul 04, 2018

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 1.5.1.0 to Sitecore Managed Cloud Services.
This upgrade brings couple of new features and fixes some issues.

Affected Sitecore Cloud Service: Managed Cloud Core services and Consumption Billing.

Impact on Customers: No downtime and no impact on live customer solutions expected.

Release summary:   

1. Improve UsagePopulation scheduler - run for current and previous month
2. Enhance historical usage service for App Center
3. Billing should not calculate Overage Quota based on slot start date
4. Update billing .NET framework and project folder
5. Update RackspaceMonthlyBillings table schema


- Posted on Jul 04, 05:00 UTC

COMPLETED: This planned upgrade has been completed successfully.
- Posted on Jul 04, 10:18 UTC

IN PROGRESS: This planned upgrade is in progress.
- Posted on Jul 04, 09:19 UTC

STARTED: Planned Upgrade has been started
- Posted on Jul 04, 08:32 UTC

Identified: 
- Posted on Jul 04, 00:00 UTC

  Jun 28, 2018

28 June 2018 Managed Cloud Infrasturcture Alert

Issue Description: subset of Managed Cloud customers in the West Europe region may have experienced difficulties connecting to App service resources with HTTP 500-level response codes. As per Microsoft Azure, this issue started happening at 16:00 UTC on 27 Jun 2018.

Impact:

Users trying to access the App Services in West Europe region may have received HTTP 500-level response codes, experienced timeouts or high latency when accessing App Service deployments hosted in these regions. 

Source:  https://azure.microsoft.com/en-us/status/  

Sitecore Cloud Engineers will keep monitoring this Azure alert as well the impacted managed cloud services and provide an update once the issue is resolved.


- Posted on Jun 27, 16:00 UTC

Mitigated: 

As per the latest Azure status, this issue has been successfully mitigated.

Source : https://azure.microsoft.com/en-us/status/history/ 


- Posted on Jun 28, 12:35 UTC

Mitigation: 

As per Microsoft, Azure Engineers have identified a possible underlying cause, and are working to determine mitigation options.

We will monitor their updates and provide status updates to this event accordingly.


- Posted on Jun 28, 04:00 UTC

Identified: This App service issue affecting certain Managed cloud West Europe Region customers has been identified.
- Posted on Jun 28, 01:30 UTC

  Jun 26, 2018

Managed Cloud Infrasturcture Alert

Issue Description: subset of Managed Cloud customers in the South Central US may have experienced difficulties connecting to resources and/or 500-level errors hosted in this region

Impact:

Virtual Machines may have rebooted unexpectedly.

Impacted services included:  App Service (Sitecore instances runtime) and also App Insights (Sitecore logging functionality) and Redis cache (Sitecore session state functionality in XP topology).

More details: https://azure.microsoft.com/en-us/status/history/

Sitecore Cloud Engineers will keep monitoring managed cloud services and provide an update once the issue is resolved.


- Posted on Jun 25, 19:40 UTC

Mitigated: Azure Engineers  have applied mitigation on the scale unit to prevent this from recurring while continuing to investigate full root cause, validating that this was isolated to a single scale unit.
- Posted on Jun 26, 05:55 UTC

Identified: 

Sitecore Cloud team have monitored the following Azure Outage:

Between 19:40 and 19:41 UTC on 25 Jun 2018, a subset of customers in South Central US may have experienced difficulties connecting to resources and/or 500-level errors hosted in this region.


- Posted on Jun 25, 07:40 UTC

  Jun 21, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources. However, during the data upload of the new web deploy packages, new Sitecore Experience Cloud instances cannot be deployed using Azure Marketplace.

Release summary:

  • Sitecore 9.0.2
  • SXA 1.7.1
  • WFFM 9.0.2
  • Enable Solr as Search Provider
  • Azure Search Replica Count Parameterization    

 


- Posted on Jun 20, 00:00 UTC

COMPLETED: This planned upgrade maintenance is now complete.
- Posted on Jun 21, 09:21 UTC

IN PROGRESS: The deployment and upgrade has been started.
- Posted on Jun 20, 09:05 UTC

Identified: 
- Posted on Jun 20, 00:00 UTC

  Jun 20, 2018

Managed Cloud Infrastructure Alert

A subset of customers in the North Europe region may experience difficulties connecting to their resources or performance degradation. Live solution not affected.

More information is available at the Microsoft Azure status page - https://azure.microsoft.com/en-us/status


- Posted on Jun 19, 17:44 UTC

MITIGATED: 

MS Azure Engineers have addressed the temperature issue, and performed a structured of the affected devices and the affected downstream services.

The issue has been mitigated.

Please refer : https://azure.microsoft.com/en-us/status/history/  &  https://azure.microsoft.com/en-us/status/


- Posted on Jun 20, 06:16 UTC

Identified: 19-Jun-2018, 17:44 UTC
- Posted on Jun 19, 00:00 UTC

  Jun 19, 2018

Deployment - Sitecore Azure Marketplace ARM templates update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

There are no updates to the Sitecore Marketplace core services or the API /SPA.

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

1) CM AppService plan Size changed to B3 on Sitecore 9.0.0 and 9.0.1

2) New product package deployment which contains ARM template changes for the Sitecore 9.0.0-Sitecore 9.0.1


- Posted on Jun 18, 00:00 UTC

COMPLETED: The data upload of the deploy package has been successfully completed & all the post deploy validations have been tested positively.
- Posted on Jun 19, 11:22 UTC

STARTED: The deployment of the ARM template changes has been started.
- Posted on Jun 19, 11:20 UTC

Identified: 
- Posted on Jun 19, 00:00 UTC

  Jun 10, 2018

Managed Cloud Infrastructure Alert

A subset of customers in the West Europe region may experience difficulties connecting to their resources or performance degradation.

More information is available at the Microsoft Azure status page - https://azure.microsoft.com/en-us/status/


- Posted on Jun 10, 04:00 UTC

Resolved: Issue has been mitigated by Microsoft Engineers.
More details: https://azure.microsoft.com/en-us/status/history/

 

- Posted on Jun 10, 10:51 UTC

Identified: 10-Jun-2018, 05:00 UTC
- Posted on Jun 10, 05:00 UTC

  May 31, 2018

Managed Cloud Infrasturcture Alert

subset of Managed Cloud customers may have experienced intermittent errors when changing infrastructure via Azure Portal. Live solution not affected.

More details: https://azure.microsoft.com/en-us/status/history/

Sitecore Cloud Engineers will keep monitoring managed cloud services and provide an update once the issue is resolved.


- Posted on May 30, 21:45 UTC

Identified: 
- Posted on May 31, 00:00 UTC

Resolved: 

Issue has been resolved by Microsoft Engineers.

More details: https://azure.microsoft.com/en-us/status/history/


- Posted on May 30, 23:50 UTC

  May 29, 2018

Sitecore App center access issue

Issue: The Sitecore App center is unavailable, due to Sitecore internal network issue.

Impact on Customers: Sitecore customers/partners won't be able to access App center.

Actual impact is that the customers/partners/sitecore account managers won't be able to view the consumption details of IP Geolocation, Sitecore Email Cloud & Sitecore Managed cloud.

Also, purchasing of a new pricing plan / subscribing to a new Sitecore cloud service / changing the existing price plan is affected.


- Posted on May 29, 13:50 UTC

Resolved: Network issue has been resolved by Sitecore engineers. App Center is in healthy state and operating normally again.
- Posted on May 29, 17:41 UTC

Identified: Unable to login to the Sitecore App center, due to Sitecore internal network issue. Sitecore engineers are working on resolve the issue. 

Updates will be posted as soon as they are available.


- Posted on May 29, 00:00 UTC

  May 27, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • Marketplace UI Changes -
    1. The Generic Important Notice messages are displayed in all the tabs, on top of the page (previously, it was only in the Environment tab).
    2. The Sitecore size has been split in to Sitecore Configuration and Size drop-downs, the Configuration can be either "Developer" or "Scaled".
    3. When the Configuration selected is “Scaled”, then the Topology Size can be chosen.
  • Marketplace API and SPA v2 
    • Data Structure Improvements
    • SPA Improvements
    • API updates to support Data Structure Improvements

 

 


- Posted on May 24, 10:10 UTC

COMPLETED: 
- Posted on May 27, 16:20 UTC

IN PROGRESS: 

Deployment in progress, No impact expected to existing or new  Sitecore Customer's Cloud resources.


- Posted on May 25, 16:56 UTC

Deployment Started: The deployment on Production has been started.
- Posted on May 24, 10:09 UTC

Identified: 
- Posted on May 24, 00:00 UTC

  May 25, 2018

CES 2.1.1 Release - IP Geo location and Tenant Info services Upgrade

Sitecore prepares an upgrade to the Contact Enrichment Services namely the Geo IP & TenantInformation Services on Azure.

Impact on Customers: No impact on live customer solutions expected.

Release Highlights:

1) Strip IP address captured in application insights to be GDPR compliant.

2) Fix various bugs related to consumption data collection & aggregation.

Bug Fixes included:

1)  Application reported wrongly when aggregating multiple apps from CESConsumption to App center consumption repository.

2)  Strip custom IP address from IP Geo URL in Application Insights

3)  Fix stream analytics query to include fields into rowId

 


- Posted on May 25, 01:00 UTC

COMPLETED: 

Upgrade successfully completed.

All services up & running.


- Posted on May 25, 16:52 UTC

IN PROGRESS: The deployment of the upgrade packages is in progress.
- Posted on May 25, 13:00 UTC

STARTED: Deployment of the upgrade release package for both IP Geo & TenantInfo Azure cloud services has been started.
- Posted on May 25, 10:56 UTC

Identified: 
- Posted on May 25, 00:00 UTC

  May 23, 2018

Managed Cloud Infrastructure Alert


- Posted on May 23, 00:00 UTC

Resolved: 

Issue resolved at 20:30 UTC on 23 May 2018

Issue has been resolved by Microsoft Engineers.

More details: https://azure.microsoft.com/en-us/status/history/


- Posted on May 23, 21:02 UTC

Identified: 

Issue started at 18:20 UTC on 23 May 2018  

A subset of Managed Cloud customers may experience issues when changing infrastructure via Azure Portal. Live solution not affected.

More details: https://azure.microsoft.com/en-us/status/

Sitecore Cloud Engineers will keep monitoring managed cloud services and provide an update once the issue is resolved.


- Posted on May 23, 00:00 UTC

  May 23, 2018

IP Geolocation and Device Detection - Consumption Issues for April-May

There was an inconsistency found in the data consumption aggregation logic on Contact Enrichment Services side. Therefore, while consumption data is still collected, the aggregated view of the consumption data may show incorrect numbers for April and May. Sitecore team is working on the issue analysis and mitigation.

Impact: Consumption data shown in App Center might be incomplete for April, May 2018 and further.

Affected Services: IP Geolocation, Device Detection


- Posted on May 18, 07:00 UTC

ISSUE RESOLVED: The internal Sitecore IP Geolocation and Device Detection configuration issue has now been rectified and we have verified that consumption data is valid and up to date.
- Posted on May 23, 11:37 UTC

Identified: The issue has been identified. Sitecore team is working on the root cause analysis and mitigation. Next updates will posted as soon as possible.
- Posted on May 18, 07:00 UTC

  May 22, 2018

Email Cloud - Web server Planned Maintenance

Sitecore is planning the maintenance activity for the Email Cloud web Server. 

 

Expected impact:During maintenance window ,Email Cloud customers Might not be able to use the Email Cloud Service.


- Posted on May 22, 10:00 UTC

Maintenance Status: 

Planned maintenance activity for the Email Cloud web Server was successfully completed. No issues were identified after the Web Server Maintenance.


- Posted on May 22, 10:50 UTC

Identified: 

Maintenance Window was required for the Email Cloud Web Server Maintenance.


- Posted on May 17, 00:00 UTC

  May 14, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • EXM 3.5.2
  • EXM 3.5.2 Support to Sitecore 8.2.7

- Posted on May 14, 11:00 UTC

Current deployment status: The update has been finished.
- Posted on May 14, 14:55 UTC

  May 11, 2018

Deployment - Managed Cloud Core Update

Sitecore Cloud Operations team is preparing the following planned Release 1.5.0.0 to Sitecore Managed Could Services.

Affected Sitecore Cloud Service: Managed Cloud Core services.

Impact on Customers: No downtime and no impact on live customer solutions expected.

Release summary:   

1. 212399 Refactor Rackspace billing schema and legacy code to remove obsolete tables and code

2. 212411 Add support to Billing for Managed Cloud Premium newest requirements

3. Internal improvements and bugs fixing: 201109, 202067, 202277, 202321, 208396, 209101,211044 

 


- Posted on May 11, 04:30 UTC

Finished: Update has been finished successfully. 
- Posted on May 11, 14:21 UTC

  Apr 28, 2018

Email Cloud - Intermittent Delays

Our underlying SMTP vendor, Sparkpost, has reported an intermittent issue with email deliverability that might caused some delays in dispatching mails via Sitecore EXM and Email Cloud solutions.

More details: https://status.sparkpost.com/incidents/fblwmlc5x9kk


- Posted on Apr 28, 13:30 UTC

Resolved: The issue was active during 1:30 PM - 4:30 PM UTC and now mitigated. No further impact expected.
- Posted on Apr 28, 17:55 UTC

  Apr 26, 2018

Deployment - Sitecore Azure Marketplace Core service update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers: No impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • Sitecore 8.2.7
  • WFFM 8.2.7
  • SXA 1.7 (only on SC 8.2.7)

- Posted on Apr 26, 10:30 UTC

COMPLETED: 

The Sitecore Azure Marketplace Core service has been updaded successfully.  


- Posted on Apr 26, 12:44 UTC

Identified: 
- Posted on Apr 05, 14:55 UTC

  Apr 25, 2018

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.313.0, 0.315.0 &  0.316.0 along with some bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore App center SPEAK UI , Sitecore Managed Cloud and Sitecore IP Geolocation offering.

Release Notes:

  • Release 0.313.0: Framework 4.0.1574,Framework.Items 4.0.1574, Framework.Api 4.0.1574
  • Release 0.315.0: ScF.Apps.GeoIP.Items 1.0.281: GeoIP Items which includes GeoIP UI Changes for the unlimited price plan support
  • Release 0.316.0: Sitecore.Apps.ManagedCloud 1.0.358
  • Various updates for improved Sitecore internal applications

Impact on customers during deployment: No impact on live customers expected, but App Center server will be restarted once closer to finish date 

Impact on customers after deployment: After the update is done,

  • The existing customers of the IP Geolocation service will find their plan being updated to “unlimited” with no associated cost. Also the existing customers will neither be able to change their “unlimited” plan nor terminate it. Customers are welcome to contact their regional Sitecore sales representatives to learn more about the change.
  • For any new customer wanting to purchase the Sitecore IP Geolocation service, only 1 option of subscribing to the “12 months unlimited plan” is available with no associated cost.

- Posted on Apr 24, 11:00 UTC

Completed: 

The production SAC servers are now upgraded to the latest handed over release builds and the pertinent smoke tests successfully validated.


- Posted on Apr 25, 12:27 UTC

In Progress: This planned upgrade which involves deployment of the release packages on to the App center servers is in progress.
- Posted on Apr 24, 06:00 UTC

Identified: The upgrade has been started.
- Posted on Apr 05, 14:55 UTC

  Apr 18, 2018

IP Geolocation service upgrade

Sitecore prepares an update to IP Geolocation service with package Release 2.1.0.

Impact on Customers: No impact on live customer solutions expected.

Release summary:

  • 201248 Update MaxMind.GeoIP2 library to 2.9.0
  • 201975 App Insights integration
  • 192048, 202435, 202456, 209426 Improved consumption tracking and reporting
  • 212292 Internal architecture optimization

- Posted on Apr 18, 11:30 UTC

Finished: Update finished. 
- Posted on Apr 18, 17:00 UTC

Identified: 
- Posted on Apr 05, 14:55 UTC

  Apr 05, 2018

Sitecore Status Page - Update 1.2.2

Update Sitecore Cloud - Status Page from v.1.2.1 to v.1.2.2 rev. 180405.

Highlights:

  • Connecting Event notifications with Status Dashboard for consistent status indicators
  • RSS enhancements to support granular updates and filters per service
  • Bug fixes

- Posted on Apr 05, 14:37 UTC

Finished: Update finished.
- Posted on Apr 05, 16:24 UTC

Initiated: Update has been started. No impact on any production Sitecore customer expected.
- Posted on Apr 05, 14:47 UTC

  Mar 30, 2018

Email Cloud - Intermittent Delays

Our underlying SMTP vendor, Sparkpost, has reported an intermittent issue with email deliverability that might caused some delays in dispatching mails via Sitecore EXM and Email Cloud solutions.

More details: https://status.sparkpost.com/incidents/d5q2qnc7c0yq


- Posted on Mar 30, 14:37 UTC

Reviewed: The issue was active during 2PM - 3 PM UTC and now mitigated. No further impact expected.
- Posted on Mar 30, 15:37 UTC

  Mar 27, 2018

Sitecore Email Cloud - messages to Yahoo domain misclassification

In period between March 14-16 an issue was reported by Yahoo. All messages that were sent to yahoo.com domain and bounced with error `554 delivery error: dd This user doesn't have a yahoo.com account ...@... [0] - mta#` should be removed. More details here: https://status.sparkpost.com/incidents/4cdsztdgf2wm

Sitecore is investigating the actual impact on Email Cloud users right now. Update will follow.


- Posted on Mar 14, 00:30 UTC

RESOLVED: Customers, who sent emails to yahoo.com domain between March 14-16 can clean the suppressions table following the steps below:
1. Take a backup of the EXM.Master SQL database or the Suppressions table
2. Run the following script against EXM.Master SQL database :
  DELETE FROM Suppressions
  WHERE 
  SuppressionStatus=0
  AND SuppressTime BETWEEN '2018-03-14 00:00:00' AND '2018-03-16 23:59:59'
  AND Email LIKE '%@yahoo%'
  AND ReasonType LIKE '%554 delivery error: dd This user doesn''t have a yahoo%account%mta#'
  
Please note, if you have been affected by this incident and choose not to clean the suppressions table, you may not be able to send emails to some valid yahoo recipients

- Posted on Mar 27, 10:54 UTC

UPDATE: All false positive suppressions have now been removed from Sparkpost. Sitecore is continuously working on determining the impact on our customers.
- Posted on Mar 23, 14:12 UTC

  Mar 21, 2018

Sitecore Azure Marketplace Outage

Affected Sitecore Cloud Service: Sitecore Azure Marketplace
Number of customers affected:  All Sitecore Customers who needed to provision/deploy/create new Sitecore Experience Cloud instances from Azure Marketplace.
Issue description: 

There was an internal Sitecore Azure marketplace configuration issue that has most probably happened during the recently completed - "Deployment - Sitecore Azure Marketplace Core service upgrade" (refer to https://status.cloud.sitecore.net/maintenance/c7d7036e-1994-464c-ba35-2a5229a33e11). 

Due to this issue, no Sitecore product selection was possible from the Sitecore Azure Marketplace.

Impact on customers: 
All Sitecore Customers who needed to provision/deploy/create new Sitecore Experience Cloud instances from Azure Marketplace could not submit their requests for Sitecore instances deployment through the Sitecore Azure Marketplace.
- Posted on Mar 21, 00:30 UTC

ISSUE RESOLVED: The internal Sitecore Azure marketplace configuration issue has now been rectified and we have verified that  this outage is no more and things are back to normal.
- Posted on Mar 21, 04:30 UTC

ROOT CAUSE IDENTIFIED: 

There was an internal Sitecore Azure marketplace configuration issue that has most probably happened during the recently completed - "Deployment - Sitecore Azure Marketplace Core service upgrade" (refer to https://status.cloud.sitecore.net/maintenance/c7d7036e-1994-464c-ba35-2a5229a33e11). 

Due to this configuration inconsistency on the Azure storage account level, the Sitecore product versions list to be fetched from the storage was not possible.


- Posted on Mar 21, 04:00 UTC

IN PROGRESS: 

Investigation of the Root cause is in progress.

Sitecore team is actively troubleshooting this issue on priority.


- Posted on Mar 21, 03:00 UTC

  Mar 20, 2018

Deployment - Sitecore Azure Marketplace Core service upgrade

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Expected impact on customers:

Existing and New customers won't be able to Deploy Sitecore Experience Cloud through Azure Marketplace.

However, existing customers can as usual work with their already deployed Sitecore Cloud resources, no impact to existing Sitecore Customer's Cloud resources.

Release summary:

  • Update EXM 3.5.1 revision to 171103 from 171102(BUG 200479)
  • Fixed EXM DDS Deployment in 9.0.1(BUG 210043)
  • Updated Auto generated Self signed certificates to support Commerce Identity Server
  • Implemented Marketplace specific important notice - To display a message about the “resource group name with underscore makes the marketplace hang”
  • Fixed Duplicate important notice when select the Store Front after selecting the commerce(BUG 207517)
  • Updated API Deployment Arm Templates to set DefaultSasTokenDurationInMinutes to 240

- Posted on Mar 20, 01:00 UTC

COMPLETED: The Sitecore Azure Marketplace Core service has been upgraded successfully. 
- Posted on Mar 20, 16:03 UTC

  Mar 05, 2018

Sitecore App Center - Planned Upgrade with Bug fixes

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.309.0, 0.310.0, 0.312.0 along with some bug fixes.

Those changes are focused on internal improvements , optimizations, key bug fixes related to Sitecore Email Cloud, Sitecore Managed Cloud and Sitecore IP Geolocation offering.

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.


- Posted on Feb 28, 06:28 UTC

COMPLETED: 

Production Appcenter has been successfully updated with the latest targetted release packages and the ad hoc hotfixes.

Post deployment validations and smoke tests passed successfully.


- Posted on Mar 05, 08:57 UTC

In Progress: This deployment is in progress.
- Posted on Feb 28, 06:34 UTC

  Feb 26, 2018

Sitecore App center login issue

Issue : Unable to login to the Sitecore App center, because the Sitecore SDN/profile authentication is failing.

Impact on Customers:  Sitecore customers/partners won't be able to access App center since they will be unable to login with their SDN/SPN/Sitecore profile credentials.

Actual impact is that the customers/partners/sitecore account managers won't be able to view the consumption details of IP Geolocation, Sitecore Email Cloud & Sitecore Managed cloud.

Also, purchasing of a new pricing plan / subscribing to a new Sitecore cloud service / changing the existing price plan is affected.


- Posted on Feb 26, 04:00 UTC

Resolved: The issue has been confirmed as resolved after 11:00 AM UTC
- Posted on Feb 26, 17:03 UTC

Identified: 

Unable to login to the Sitecore App center, because the Sitecore SDN/profile authentication is failing.

Sitecore is actively working upon this issue towards resolution.

Updates will be posted as soon as they are available on priority.


- Posted on Feb 26, 07:56 UTC

  Feb 12, 2018

Managed Cloud Core service update

Sitecore prepares an update to Sitecore Managed Cloud Core service with package Release 1.4.3.0.

 

Those changes are focused on internal improvements and optimizations related to Azure consumption statistics. Also, this release finally puts functionality of viewing Managed Cloud Consumption statistics into production accessible for all customers (#191117). Read more here: https://doc.sitecore.net/managed_cloud/sitecore_managed_cloud_overview/view_your_managed_cloud_consumption.

 

Impact on Customers: No impact on live customer solutions expected.


- Posted on Feb 12, 12:10 UTC

Finished: The Managed Cloud core service update has been completed.
- Posted on Feb 12, 14:28 UTC

  Feb 12, 2018

App Center - Planned weekend maintenance for login functionality

Over the weekend, Sitecore will be running maintenance on App Center related infrastructure. This will result in unavailability of App Center UI and its login functionality, so new purchases and reviewing consumption functions won't be available.

All active subscriptions and apps should work without any issues during the maintenance period.


- Posted on Feb 10, 06:00 UTC

Finished: As planned, the maintenance took place during weekend and finished successfully. Event is closed.
- Posted on Feb 12, 08:05 UTC

Scheduled: Maintenance has been scheduled
- Posted on Feb 09, 08:02 UTC

  Jan 30, 2018

Sitecore App Center - Update releases 0.305.0, 0.306.0, 0.307.0, 0.308.0

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.305.0, 0.306.0, 0.307.0, 0.308.0.

Those changes are focused on internal improvements and optimizations related to Sitecore Email Cloud, Sitecore Managed Cloud.

This update also corrects the IP Geo-location consumption reporting (#200108)

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.


- Posted on Jan 29, 10:00 UTC

Completed: 

This App center upgrade/update in the form of deployment of latest release packages has been completed successfully.

Sitecore App center is up & running as usual.


- Posted on Jan 30, 18:43 UTC

In Progress: This App center upgrade/update in the form of deployment of latest release packages has been started & is in progress.
- Posted on Jan 30, 18:41 UTC

  Jan 25, 2018

Managed Cloud Web App Services issue in East US region

Summary of impact: 

Managed Cloud customers from East US may experience intermittent latency, timeouts or HTTP 500-level response codes while performing service management operations such as site create / delete and moving resources on App Service deployments. Autoscaling and loading site metrics may also be impacted.  

Next steps:

Sitecore Operations will monitor the Azure's maintenance and report further updates on Status Page.


- Posted on Jan 24, 08:00 UTC

Resolved: Microsoft Engineers performed a change to the service configuration to optimize traffic which mitigated the issue.
- Posted on Jan 25, 07:50 UTC

  Jan 19, 2018

Deployment - Sitecore Azure Marketplace - Marketplace Upgrades with Sitecore9.0.1, SXA1.6 & WFFM9.0.1 Product Packages

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.  Upgrade will be started soon.

 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

Release summary:

1)  Provision for deploying Sitecore 9.0.1

2)  Sitecore Module SXA 1.6

3) Sitecore Module  WFFM9.0.1 

 

Expected impact on customers:

Existing and New customers won't be able to Deploy Sitecore Experience cloud through Azure Marketplace.

However, existing customers can as usual work with their already deployed Sitecore Cloud resources, no impact to existing Sitecore Customer's Cloud resources.

 

Release details:

  • Sitecore 9.0.1
  • SXA 1.6
  • WFFM 9.0.1
  • Module level Important notice support
  • Enable/Disable DDS role installation support
  • Module Dependency Support 

- Posted on Jan 17, 06:00 UTC

COMPLETED: The Sitecore Azure Marketplace has now been upgraded & updated with the latest product packages of this release
- Posted on Jan 19, 10:27 UTC

  Jan 19, 2018

App Center Client Accessing Issue


- Posted on Jan 18, 19:10 UTC

RESOLVED: 

We’ve now rectified this issue on the App center server.

Once we disabled the remaining active license for Email delivery  which was for our internal testing purposes,we are no longer seeing this error anymore from the app center interface once we login.

It has now been verified that the App center interface is loading normally on login without any such errors.


- Posted on Jan 19, 10:19 UTC

Summary of impact: 

There is an issue in accessing the App Center client (Public) portal with error message "There was an Error in the communication with Sitecore App Center server". The Sitecore services (Sitecore Email Cloud, IP Geolocation, Device Detection (for 8.1 - 8.2)) are working with no issues but purchasing and service termination are unavailable until this issue is resolved.

Please reach out to Sitecore Support in case of any questions.

 

Next steps: Sitecore Engineers are currently working on resolving this issue and will update the status page once the issue is resolved.


- Posted on Jan 18, 19:11 UTC

  Jan 17, 2018

Device Detection Database download issue

 

 


- Posted on Jan 05, 13:59 UTC

Resolved: 

Reported issues with Device Detection service were resolved. Customers on Sitecore 9.0 will be able to download the updated Database from Device Detection service.

 


- Posted on Jan 17, 13:08 UTC

Identified: 

Customer running Sitecore 9.0 can face issues with downloading the updated database from Device Detection Service. Sitecore Operation team is reviewing the issue.

 

 


- Posted on Jan 05, 14:03 UTC

  Jan 15, 2018

App Center - Data Center Migration

On 13-Jan-2018, Sitecore will be migrating underlying App Center infrastructure to another data center. This will cause intermittent unavailability of App Center and various cloud services to be unavailable during 13-14 January 2018.

Impact: during maintenance window, it won't be possible to use Sitecore App Center UI, Sitecore Email Cloud, IP Geolocation, Device Detection (for 8.1 - 8.2) services.

Reach out to Sitecore Support in case of any questions.


- Posted on Jan 13, 12:00 UTC

Finished: App Center maintenance finished successfully.
- Posted on Jan 15, 08:23 UTC

Impact Clarified: 

At the time of maintenance progress, impact on Sitecore services is being continuously reviewed.

For now, it's confirmed that IP Geolocation and Email Cloud services are online and not impacted by the maintenance (actual impact was negligible).

Remaining impact: App Center UI is not accessible, Email Cloud consumption data might be unavailable in EXM dashboard, Spam Check and Email Preview.

Sitecore team will continue investigating the ways to minimize the impact on remaining services during the maintenance window and after completion.


- Posted on Jan 13, 21:48 UTC

Started: 

Maintenance started. Planned finish time 20:00 UTC, 14 Jan 2018.

Impact: during maintenance window, it won't be possible to use Sitecore App Center UI, Sitecore Email Cloud, IP Geolocation, Device Detection (for 8.1 - 8.2) services.
Reach out to Sitecore Support in case of any questions.


- Posted on Jan 13, 08:32 UTC

Scheduled: Maintenance has been scheduled
- Posted on Dec 26, 11:35 UTC

  Jan 12, 2018

Deployment - Sparkpost EU Connector service

 

Sitecore Cloud Operations team is preparing a planned update on Sparkpost EU Connector service.  Upgrade will be started soon.

  

No Expected impact on customers:  Update of Sparkpost EU Connector service will not impact any customer. No downtime is expected.

 


- Posted on Jan 11, 08:41 UTC

  Jan 11, 2018

Deployment - Sitecore Azure Marketplace - Marketplace Upgrades with Sitecore9.0.1-SXA1.6 Product Package

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.  Upgrade will be started soon.

 

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace

 

Release summary:

1)  Provision for deploying Sitecore 9.0.1

2)  Support for SXA 1.6

       

Expected impact on customers:

Existing and New customers won't be able to Deploy Sitecore Experience cloud through Azure Marketplace.

However, existing customers can as usual work with their already deployed Sitecore Cloud resources, no impact to existing Sitecore Customer's Cloud resources

Release details:

              -         Sitecore 9.0.1

-          SXA 1.6

-          Module level Important notice support

-          Enable/Disable DDS role installation support

-          Module Dependency Support


- Posted on Jan 11, 01:00 UTC

CANCELLED: Due to an issue with the Sitecore 9.0.1 release for Azure deployments, this will necessitate a rebuild of platform Web Deploy Packages.
Hence , till we are ready with the updated release packages, this Azure Marketplace Update stays cancelled.
- Posted on Jan 11, 12:40 UTC

  Jan 11, 2018

Managed Cloud And xDB Cloud - VM Maintenance on Azure side

Our Managed Cloud and xDB Cloud vendor, Microsoft Azure will be performing a critical, security-related maintenance-hardware-based security vulnerability (CPU vulnerability) that was identified & disclosed today by Azure.

Various VMs used for delivery of Sitecore xDB Cloud & Managed Cloud services will be rebooted, in order to apply the security fix.

Especially, this may affect Azure VMs under Managed Cloud subscriptions (if any), MongoDB databases availability on xDB Cloud and Managed Cloud xP / xDB sets, xDB Cloud Core services (e.g. REST API).

The maintenance reported start date as of 3:30pm PST on January 3, 2018.

For detailed issue description,  please refer to:

  1. https://azure.microsoft.com/en-us/blog/securing-azure-customers-from-cpu-vulnerability/
  2. https://status.mlab.com/

 


- Posted on Jan 03, 23:30 UTC

Resolved: 

Azure VM Maintenance is now complete & all the Sitecore customer Azure VM's & their Mongo Deployments are now up & running after the patch.


- Posted on Jan 11, 11:16 UTC

Issue resolved: 

VM Maintenance on Azure side is done & all the customer's Azure VM resources & Mongo deployments are now up & running.

 
- Posted on Jan 11, 10:56 UTC

Sitecore Workaround: 

In particular cases, occasional downtime of MongoDB hosted in xDB Cloud / Managed Cloud may lead to Sitecore Content Delivery instances outage or performance degradation.

To learn more about this scenario and about the steps to protect your Sitecore solution from outage, please refer to the following article: https://kb.sitecore.net/articles/930657.


- Posted on Jan 04, 16:09 UTC

Impact Update: As of now, we observe more significant impact on MongoDB servers caused by this maintenance. It leads to longer windows of unavailability (up to 10-20 minutes). We investigate this situation with the vendor to minimize the impact.
- Posted on Jan 04, 12:06 UTC

Identified: 

Azure's Alert has been identified and analyzed from Sitecore perspective. Event entry now posted. Sitecore Operations will monitor the Azure's maintenance and report further updates in this Status Page entry.


- Posted on Jan 04, 09:02 UTC

  Jan 09, 2018

Limited Monitoring Capabilities

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified an issue that limits our monitoring capabilities.

Affected Sitecore Cloud Service: No services affected.

Customers affected: Customers are not affected.

Expected impact on Customers: No impact.

Sitecore Cloud Operations team is working to resolve the issue.


- Posted on Jan 07, 10:15 UTC

Resolved: The internal incident preventing full-featured 24x7 cloud monitoring has been addressed on 08-Jan-2018 after 8:00 PM UTC. All support processes are restored
- Posted on Jan 09, 08:39 UTC

Started: 

The issue was identified.


- Posted on Jan 07, 10:15 UTC

  Jan 05, 2018

Sitecore Cloud services - DNS maintenance

On 05-Jan-2018, Sitecore will perform a maintenance around our underlying Managed DNS provider. This includes *.cloud.sitecore.net and *.sitecore.net domains.

Such domains are used for xDB Cloud 1.0 - 2.0, Email Cloud, App Center and various apps service delivery.

Although no impact on Sitecore customers is expected, Sitecore Cloud Operations will be monitoring the maintenance. Any potential issues will be posted on this page.


- Posted on Jan 05, 01:00 UTC

Finished: Maintenance has completed successfully.
- Posted on Jan 05, 19:53 UTC

Starting: Maintenance expected start is 9:00 PM UTC today. Sitecore Operations team will monitor and report the progress upon completion.
- Posted on Jan 05, 15:03 UTC

Scheduled: Maintenance has been scheduled
- Posted on Dec 26, 09:08 UTC

  Jan 03, 2018

Email Cloud - Intermittent service availability issues due to vendor incident

Underlying Email Cloud vendor, SparkPost, has reported various API errors and latency. Check more details at https://status.sparkpost.com/incidents/t9yg8f380fxv

Impact: Sitecore EXM and Email Cloud customers might have experienced increased latency and intermittent errors on various EXM actions requiring direct connection to Sparkpost API under the hood.

Resolution: This incident has been resolved already by vendor, so no further impact on Sitecore customers.


- Posted on Jan 03, 02:00 UTC

  Dec 29, 2017

Sitecore Managed Cloud - monitoring improvement


- Posted on Dec 29, 09:00 UTC

Finished: Update successfully finished.
- Posted on Dec 29, 16:00 UTC

Started: 

Sitecore team is performing minor updates of customers' resources for monitoring improvements. No impact expected.


- Posted on Dec 29, 09:20 UTC

  Dec 27, 2017

Status Page - Update to v.1.2.1

Update Sitecore Cloud - Status Page from v.1.2 to v.1.2.1 rev. 171227.

Highlights:

  • Labels and coloring adjustment (now, active/resolved events easily recognizable by color)
  • Expandable details in status metrics list 
  • Bug fixes

- Posted on Dec 27, 15:55 UTC

Ready: Update has been seamlessly deployed
- Posted on Dec 27, 16:00 UTC

  Dec 23, 2017

Email Cloud (Sparkpost) - Connector Credentials Service is unavailable

As part of cloud infrastructure monitoring activities, Sitecore Cloud Operations team identified that Sparkpost Connector Credentials Service is unavailable (Email Cloud for EXM 3.4+).

Affected Sitecore Cloud Service: Email Cloud (Sparkpost) 

Customers affected: Email Cloud (Sparkpost) Customers

Expected impact on Customers: New session cannot be established and new email dispatch cannot be started.

Sitecore Cloud Operations team is working to resolve the issue.


- Posted on Dec 23, 09:45 UTC

Finished: 

The issue was resolved. Email Cloud (Sparkpost) - Connector Credentials Service is operating normally.


- Posted on Dec 23, 13:00 UTC

Started: 

The issue was identified. Email Cloud (Sparkpost) - Connector Credentials Service is unavailable.


- Posted on Dec 23, 09:45 UTC

  Dec 22, 2017

Sitecore App Center - Update 0.295

Sitecore Cloud Operations prepares an update to Sitecore App Center - Release 0.295.

The changes are intended to introduce new functionality for Managed Cloud Consumption.

 

- Posted on Dec 20, 09:36 UTC

Finished: 

 Sitecore App Center Update was deployed Successfully.


- Posted on Dec 22, 13:16 UTC

Started: 

 Sitecore App Center Update Started.


- Posted on Dec 22, 09:30 UTC

  Dec 21, 2017

Sitecore App Center - Device Detection Update

Retrospective notification to the change introduced with a small App Center configuration update on 11-Dec-2017.

The change leads to inability of purchasing new subscription of Device Detection for Sitecore 8.2 and earlier. Please note that Sitecore 9.0 provides Device Detection service out of the box without App Center subscription.


- Posted on Dec 21, 12:44 UTC

Summary posted: This alert is posted to reflect actual configuration change applied before
- Posted on Dec 21, 12:49 UTC

Change applied: Configuration change has been applied on 11-Dec-2017
- Posted on Dec 11, 12:48 UTC

  Dec 18, 2017

Deployment - Managed Cloud Core Update

Impact: no impact expected.
- Posted on Dec 18, 01:10 UTC

Finished: The update was finished successfully.

- Posted on Dec 18, 13:41 UTC

  Dec 13, 2017

xDB Cloud Core services upgrade

xDB Cloud Core services and xDB Cloud REST API scheduled upgrade. No impact on customers expected.
- Posted on Dec 13, 09:00 UTC

Finished: Upgrade completed successfully.
- Posted on Dec 13, 09:59 UTC

Started: xDB Cloud Core services and xDB Cloud REST API scheduled upgrade started. No impact on customers expected.
- Posted on Dec 13, 09:03 UTC

  Dec 10, 2017

App Center - Planned Hardware Maintenance

On 10-Dec-2017, Sitecore IT will be performing a hardware maintenance. This will cause a downtime on the hosting infrastructure used for SDN.sitecore.net, SPM.sitecore.net, marketplace.sitecore.net, profile.sitecore.net and also some critical internal dependencies of Sitecore App Center.

Impact on Sitecore cloud customers: inability to log in App Center UI. Existing subscriptions and apps (like IP Geolocation etc.) will not be affected.


- Posted on Dec 10, 01:00 UTC

Finished: The maintenance was finished successfully
- Posted on Dec 10, 19:37 UTC

Started: As of 04:00 AM UTC, the maintenance is in progress. As expected, App Center UI login functionality may not work during this time. No impact on other services discovered.
- Posted on Dec 10, 10:41 UTC

Scheduled: The maintenance window has been scheduled for 10-Dec-2017
- Posted on Dec 07, 08:05 UTC

  Dec 01, 2017

Sitecore Email Cloud - Intermittent issues experienced

Starting 17-Nov-2017, 03:00 UTC Email Cloud reported a couple of availability alerts. The service should be working fine now. However, Sitecore team is investigating the root cause of occurred alerts to ensure no further impact on customers.
- Posted on Nov 17, 10:41 UTC

Closure and RCA: After detailed validation, the root cause has been determined within the underlying application code. Sitecore will schedule appropriate fixes in the code for the nearest release. In the meantime, Email Cloud system proves to be stable in the current tier, so system stability is under control now. The event is closed.
- Posted on Dec 01, 12:07 UTC

Analyzed and fixed: 

After investigation, it was confirmed that experienced interim outage appeared due to recent server scale out. The behavior of Email Cloud system with multiple instances appeared less stable. Therefore, the infrastructure has been scaled down on 14:00 UTC to single instance and now system becomes stable.

Summary of the impact: during the issue time frame, customers using EXM with Email Cloud may experience delays on Sitecore start-up or when viewing Email Cloud usage statistics via EXM Dashboard. No impact on email dispatching function has been identified.

Next steps: Sitecore continue dedicated monitoring of the stability after the fix enrollment. We will update the status after healthy status can be permanently confirmed.


- Posted on Nov 17, 15:02 UTC

Identified: Sitecore identified an alert and currently investigate the details of experienced behavior. Further updates will be posted soon.
- Posted on Nov 17, 10:44 UTC

  Nov 26, 2017

App Center - Web server maintenance

On 25.11.2017, 10:00 UTC, Sitecore is planning the maintenance activity for the App Center web server. Please find the details below.

  • Reason: moving to new hardware, increasing the Disk storage space on the Sitecore App Center web server
  • Downtime expected: 10 minutes during the scheduled period
  • Impact on customers: inability to access App Center UI and Email Cloud consumption; inability to use App Center Apps like Spam Check, Email Preview, Email Cloud. Ongoing Email Cloud dispatches should not be affected.

- Posted on Nov 25, 10:00 UTC

Finished: The update has been performed on Saturday, 25-Nov-2017, between 8:00 and 10:00 UTC. All systems returned online just in 5 minutes during this timeframe. No additional issues were determined within further monitoring.
- Posted on Nov 26, 21:33 UTC

Scheduled: The maintenance even has been scheduled
- Posted on Nov 22, 13:22 UTC

  Nov 23, 2017

Sitecore Azure Marketplace - Planned Upgrade

Planned:

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.  Upgrade will be started soon.

 

Expected impact:

No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.


- Posted on Nov 23, 13:09 UTC

Finished: The upgrade was finished successfully.

- Posted on Nov 23, 18:00 UTC

  Nov 19, 2017

Managed Cloud and xDB Cloud - Azure Network Infrastructure issue in North Central US

Starting at 05:40 UTC on 18 Nov 2017 a subset of customers with resources in Azure's North Central US data center may experience connectivity issues as reported by Azure Status Page. Some customers using App Service (Web Apps) may experience latency or timeouts. Sitecore is validating the impact on our cloud infrastructure.


- Posted on Nov 19, 06:00 UTC

Closed: The issue was fixed by Microsoft on November 19th 2017.

- Posted on Nov 19, 14:06 UTC

Update: After deep investigation from Sitecore side, we have found that the issue is not affected our current customers. However, we continue monitoring the state.
- Posted on Nov 19, 10:15 UTC

Identified: The alert has been identified and the investigation process has been started.
- Posted on Nov 19, 09:00 UTC

  Nov 15, 2017

Azure Marketplace and Managed Cloud - New Sitecore provision may not work

Sitecore monitoring identified an error with provisioning of Sitecore Experience Platform (XP) and Experience Manager (XM) instances via standard ARM templates.

The following error may appear in Azure Portal for the target resource group:

"Deployment template validation failed: 'The template resource 'templateLinkBase' at line '27' and column '25' is not valid: The template language function 'replace' expects its first parameter to be of type 'String'. The provided value is of type 'Uri'. Please see https://aka.ms/arm-template-expressions for usage details.. Please see https://aka.ms/arm-template-expressions for usage details.'."

This immediately affects Sitecore provision feature via Azure Marketplace and Sitecore Managed Cloud.

Our team is actively looking for a workaround.


- Posted on Nov 13, 13:48 UTC

Closed: The issue has been fixed by Microsoft on November 15th 2017. We confirm that Provisioning via Azure Marketplace and Azure Toolkit now works as expected.
- Posted on Nov 15, 13:11 UTC

Workaround available: For Azure Toolkit, workaround has been published at https://kb.sitecore.net/articles/143510. This unblocks any Sitecore on Azure and Sitecore Managed Cloud provisioning. Root cause and permanent solution investigation is continuing with Microsoft support. Sitecore Azure Marketplace remains unavailable, Sitecore is looking for the workaround as well.
- Posted on Nov 13, 20:30 UTC

Identified: Issue with Sitecore provision via standard ARM templates has been identified. We are working on the exact impact identification and root cause analysis.
- Posted on Nov 13, 13:51 UTC

  Nov 12, 2017

Managed Cloud and xDB Cloud - Azure SQL databases North Europe and West Europe issues when working via Azure portal

Starting at 04:45 UTC on 11 Nov 2017, Azure has reported an issue that customers using SQL Database in West Europe and North Europe may experience issues managing existing databases via the Azure Management Portal (https://portal.azure.com) and Powershell. During this time, customers may experience higher than normal latency resulting in errors or timeouts ("Gateway timeout”). Azure team is working on the fix.


- Posted on Nov 11, 04:45 UTC

Summary of impact: Between 04:45 and 18:51 UTC on 11 Nov 2017, a subset of customers using SQL Database in North and West Europe may have experienced issues provisioning new databases and managing existing databases via the Azure Management Portal () and Powershell. During this time, customers may have also experienced high latency resulting in errors or timeouts ("Gateway Timeout"). Downstream impact may also have been experienced by HDInsight customers who may have seen deployment failure notifications for the creation of new HDInsight clusters in these regions. This did not affect the availability of existing resources hosted in these regions.
- Posted on Nov 12, 05:05 UTC

Mitigated: MS Azure Engineering discovered a specific check that was causing the regression and isolated this from the production environment. Engineering disabled a specific check that was causing excessive number of requests on the service side. This operation freed capacity and allow service management operations to succeed. 
- Posted on Nov 12, 05:03 UTC

Identified: MS Azure Engineers determined that a regression that was causing increases in traffic between datacenters and consequently an increased latency when performing service management operations on SQL Databases in these regions. These caused some service management operations to timeout.
- Posted on Nov 12, 04:59 UTC

  Nov 10, 2017

Managed Cloud and xDB Cloud - Azure Issue with Redis Cache and VMs

Starting 09:00 UTC, Azure reported an issue with multiple Virtual Machines and Redis Cache instances.

Sitecore monitoring has noted an intermittent impact to xDB Cloud Core services and a few Managed Cloud instances in North/West Europe (Redis Cache).


- Posted on Nov 10, 09:00 UTC

Mitigated: According to Azure status page, the issue has been completely resolved.
Our alerting system no longer reports any outages with Sitecore infrastructure, so issue is mitigated for Sitecore as well.
- Posted on Nov 10, 14:15 UTC

Identified: 

Short downtime (for a few minutes in a period of 09:00-11:00 UTC) has been identified for xDB Cloud Core services affecting xDB Cloud REST API and xDB Cloud 1.0 connectivity.

Redis Cache impact on Sitecore services is being investigated.


- Posted on Nov 10, 11:14 UTC

  Nov 10, 2017

Sitecore App Center - Update releases 0.281,0.283,0.285

Sitecore prepares an update to Sitecore App Center server side with Release packages 0.281,0.283,0.285.

Those changes are focused on internal improvements and optimizations.

Impact on Customers:    No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.

 


- Posted on Nov 08, 04:00 UTC

Completed: Deployment completed on the production App center servers. All the smoke tests of post deploy validations have passed successfully.
The Sitecore App center has been successfully upgraded to these release packages.
- Posted on Nov 10, 11:14 UTC

Started: The Production deployment is in progress
- Posted on Nov 09, 13:00 UTC

Scheduled: Upgrade has been scheduled
- Posted on Nov 07, 17:23 UTC

  Nov 09, 2017

Sitecore Email Cloud - Service Issue

Due to on-going issue on Sparkpost Enterprise side (underlying Email Cloud provider), the whole Email Cloud solution may be impacted.

More details on Sparkpost page: https://status.sparkpost.com/incidents/nx70rfdrzt9k

Sitecore is working on clarifying the impact and resolution steps with provider closely.


- Posted on Nov 08, 13:16 UTC

Closed: After further monitoring and final confirmation from the vendor, the alert is close. All Email Cloud systems are functioning as expected.
- Posted on Nov 09, 09:24 UTC

Update: Our provider reports stabilization of the system, so Email Cloud should be stable as well. Internal Sitecore telemetry shows no issues with Email Cloud system, we continue monitoring the state.
- Posted on Nov 08, 15:31 UTC

Identified: The issue has been identified. Currently known impact: intermittent unavailability of Sitecore Email Cloud services (including SMTP/dispatch function). The issue is under investigation.
- Posted on Nov 08, 13:18 UTC

  Nov 06, 2017

xDB Cloud Core service planned upgrade


- Posted on Nov 06, 15:00 UTC

Finished: Upgrade was finished successfully.
- Posted on Nov 06, 15:54 UTC

Planned upgrade: xDB Cloud Core services planned upgrade. No impact on customers expected.
- Posted on Nov 06, 14:00 UTC

  Nov 05, 2017

Status Page - Update to v.1.2

Update Sitecore Cloud - Status Page from v.1.0 to v.1.2 rev. 171105.

Highlights:

  • v.1.1 - Automatic Metrics feature preview: for Email Cloud and for Managed Cloud Core metrics.
    This feature enables automatic update of respective statuses (every 5 minutes), reflecting Sitecore Support monitoring alerts. It's available in preview only for now
  • v.1.2 - RSS feature for Maintenance entries. Single Maintenance Entry page. Enhanced (rich) text format for status maintenance updates available

- Posted on Nov 05, 23:05 UTC

Finished: Update to newer version finished successfully. A few minutes downtime noted for Sitecore Cloud Status Page near 23:30 UTC.
- Posted on Nov 05, 23:54 UTC

Started: Update is scheduled and immediately started. No negative impact on any Sitecore production systems expected.
- Posted on Nov 05, 23:12 UTC

  Nov 02, 2017

Managed Cloud and xDB Cloud 2.0 alert - new environments creation


- Posted on Nov 02, 17:32 UTC

Resolved: Azure storage issue has been resolved by Microsoft engineers. Please refer to the following link for more information https://azure.microsoft.com/en-us/status/history/
- Posted on Nov 02, 18:16 UTC

Identified: 

There's an issue with Azure storage which might cause an error when provisioning new xDB and Managed cloud sets (or Rename, Delete, etc. ) and creating new mlab deployment. Existing customers are not affected.

Microsoft engineers have applied mitigation and are in the final stages of validating that there is no further impact.

Please refer to the following link for more information https://azure.microsoft.com/en-us/status/


- Posted on Nov 02, 17:39 UTC

  Nov 02, 2017

Sitecore App Center - Unavailability due to production webserver down

App center servers are back online & up & running.

App center UI login & management order UI working normally along with the Sitecore Email cloud service.


- Posted on Nov 02, 03:00 UTC

Resolved: 

App center servers are back online & up & running.

App center UI login & management order UI working normally along with the Sitecore Email cloud service.

 

- Posted on Nov 02, 08:28 UTC

Identified: 

App Center endpoint (https://apps.sitecore.net) not reachable, login to App Center UI affected, purchasing unavailable & customer's subscriptions impacted.

Also, other services like Email Preview, Spam Check, Email Cloud (consumption statistics in EXM) are also affected.

Sitecore teams are actively looking & working on this outage to minimize the downtime.


- Posted on Nov 02, 03:00 UTC

  Oct 31, 2017

Sitecore Azure Marketplace - Planned Upgrade

Azure Marketplace data update (product packages fixes for Sitecore 8.2.3 and 9.0.0).


- Posted on Oct 31, 10:00 UTC

Completion: Azure Marketplace data update (product packages fixes for Sitecore 8.2.3 and 9.0.0) completed successfully

 

- Posted on Oct 31, 10:00 UTC

  Oct 26, 2017

xDB Cloud - Intermittent Azure Storage Connectivity - West US

 


- Posted on Oct 26, 16:45 UTC

Issue Resolved: Azure Engineers have ceased this maintenance activity and will perform a full root cause analysis.
- Posted on Oct 26, 20:30 UTC

Cause Confirmed: Azure support identified that a scheduled maintenance activity caused this issue.
- Posted on Oct 26, 19:00 UTC

Unplanned Disruption: As reported by Azure Support (Azure Status History), a subset of xDB Cloud 1.0 and 2.0 customers may experience intermittent difficulties connecting to resources that rely on Azure Storage based in the West US data center.  This disruption can include interruptions to MongoDB resources (mLab Status) that also rely on Azure storage in that data center region.

 

- Posted on Oct 26, 16:45 UTC

  Oct 15, 2017

xDB Cloud and Managed Cloud - Mongo SSL certificates update

On a subset of customers using xDB Cloud 1.0 - 2.0 and Managed Cloud (xP or xDB topologies), MongoDB clusters maintenance will be performed to update SSL certificates. The update will be seamless, but may require a failover, which may lead to couple of seconds of MongoDB unavailability. Sitecore Platform will gracefully handle such small unavailability, so no impact expected.
- Posted on Oct 14, 19:00 UTC

Finished: All the remaining clusters now updated. Maintenance is finished successfully.
- Posted on Oct 15, 21:34 UTC

Continued: First batch of clusters has been upgraded, no issues occurred. However, overall duration of maintenance increased to next day. Upgrade of remaining clusters will be started soon today. The whole maintenance should be finished by the end of today.
- Posted on Oct 15, 15:12 UTC

Started: Maintenance has been started
- Posted on Oct 14, 20:30 UTC

Scheduled: On a subset of customers using xDB Cloud 1.0 - 2.0 and Managed Cloud (xP or xDB topologies), MongoDB clusters maintenance will be performed to update SSL certificates. The update will be seamless, but may require a failover, which may lead to couple of seconds of MongoDB unavailability. Sitecore Platform will gracefully handle such small unavailability, so no impact expected.
- Posted on Oct 14, 08:42 UTC

  Oct 14, 2017

Sitecore App Center - Unavailability due to dependent service error

On 13-Oct-2017 8:00 PM UTC, Cloud Operations team found an issue with one of the underlying service behind Sitecore App Center.

Sitecore App Center functionality is partially unavailable. Work on impact and workaround determination has been started.


- Posted on Oct 13, 21:00 UTC

Resolved: The issue has been resolved at 11:00 AM UTC. All systems returned online.
- Posted on Oct 14, 13:02 UTC

Impact Clarified: 

Confirmed impact as of now: inability to log into App Center UI, inability to view Email Cloud subscription statistics in EXM dashboard.

Dispatching messages via Email Cloud service is not affected and working fine.


- Posted on Oct 14, 08:34 UTC

Identifying: 

After 13-Oct-2017 8:00 PM UTC, Cloud Operations team found an issue with one of the underlying service behind Sitecore App Center.

Sitecore App Center functionality is partially unavailable. Work on impact and workaround determination has been started.


- Posted on Oct 13, 22:10 UTC

  Oct 14, 2017

Sitecore App Center - Update 0.278

Sitecore Cloud Operations prepares an update to Sitecore App Center - Release 0.278.

The changes are intended to address a few login related issues and introduce new functionality for further Sitecore releases.


- Posted on Oct 10, 01:00 UTC

Finished: Upgrade has been finished
- Posted on Oct 14, 05:30 UTC

OnGoing: 

During upgrade, Sitecore App Center and Sitecore Email Cloud services were unavailable for short period of time ( 10 - 15 mins) on 13 Oct 2017 in the 1st half of the day ( UTC).

The issue has been addressed to prevent further failures on that matter.


- Posted on Oct 13, 10:00 UTC

Starting: Upgrade has been started. No impact on any customers expected.
- Posted on Oct 13, 05:03 UTC

Scheduled: Update to Sitecore App Center service is scheduled, Release 0.278 will be rolled out in nearest upgrade window.

The changes are intended to address a few login related issues and introduce new functionality for further Sitecore releases.
- Posted on Oct 10, 10:00 UTC

  Oct 13, 2017

Sitecore Azure Web App deployment issues - Existing clients are not affected

There are issues when deploying Sitecore solution to Azure PaaS environment due to recent change of the Microsoft Azure platform.

Sitecore works closely with Microsoft to find issue's root cause and possible workarounds.

Details: https://kb.sitecore.net/articles/755670

 


- Posted on Sep 19, 21:14 UTC

Issue fixed: Issue with new deployments provisioning is now fixed for xDB Cloud and Managed Cloud services.
- Posted on Oct 13, 11:37 UTC

Permanent fix partially: Permanent fix now applied to Sitecore Azure Toolkit, Managed Cloud and Sitecore provisioning via Azure Marketplace. xDB Cloud 2.0 provisioning stability confirmation is pending.
- Posted on Oct 11, 12:33 UTC

Workaround found: 

The root cause, scope of impact as well as possible workarouds were identified and now available.

Please check KB article for details: https://kb.sitecore.net/articles/755670

Workaround available for: Sitecore deployments via Sitecore Azure Toolkit, Sitecore Managed Cloud

Workaround/fix in progress for: Sitecore Azure Marketplace, xDB Cloud 1.0 - 2.0


- Posted on Sep 22, 08:29 UTC

Investigation in progress: 

Sitecore works closely with Microsoft to find issue's root cause and possible workarounds.

Further updates will be posted here and in the appropriate KB article.


- Posted on Sep 19, 23:00 UTC

Issue Identified: 

We have identified some issues when deploying Sitecore solution to Azure PaaS environment due to recent change of the Microsoft Azure platform.

Details about the error: https://kb.sitecore.net/articles/755670 

Affected services: Sitecore Managed Cloud, xDB Cloud 1.0 - 2.0, Sitecore Azure Marketplace and any Sitecore PaaS deployments via Sitecore Azure Toolkit to Azure Web Apps


- Posted on Sep 19, 21:14 UTC

  Oct 12, 2017

Sitecore Azure Marketplace API & SPA Update

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure.

The update provides a few new features to support further Sitecore releases. Also, UI has been improved with better retention of values in configuration pages.

Expected impact on customers:   No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.


- Posted on Oct 12, 11:30 UTC

Completed: Sitecore Azure Marketplace infrastructure has been upgraded successfully.
- Posted on Oct 12, 12:51 UTC

Planned: 

Sitecore Cloud Operations team is preparing a planned update on Azure Marketplace infrastructure. The update provides a few new features to support further Sitecore releases. Also, UI has been improved with better retention of values in configuration pages. Upgrade will be started soon.

Expected impact: No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch


- Posted on Oct 12, 11:00 UTC

  Oct 10, 2017

Outage for Email Cloud EXM 3.4 +

Issue Identified: We have identified some issues  with our Service Email Cloud EXM 3.4 +. All Customer using Email Cloud EXM 3.4 + are effected.
- Posted on Oct 09, 15:43 UTC

Issue Resolved: In collaboration with Microsoft Azure Support, vendor of connector service, the root cause of issue was identified and resolved.
- Posted on Oct 10, 13:03 UTC

Workaround in progress: Connector app redeployment is now in progress by Sitecore Cloud Operations
- Posted on Oct 10, 05:10 UTC

Cause confirmed: In collaboration with Microsoft Azure Support, vendor of connector service, the root cause of issue was identified in the infrastructure. The workaround being suggested as full app redeployment.
- Posted on Oct 10, 03:05 UTC

Issue Identified: 

Starting ~ 13:00 UTC today, we have identified an issue with our cloud service behind Email Cloud solution for EXM 3.4+. Our team is actively working on identifying potential workaround.

Impact on customers: Sitecore Email Experience Manager (EXM) does not work with Email Cloud.


- Posted on Oct 09, 16:02 UTC

  Oct 10, 2017

IP Geo and Device Detection - Server Code Update


- Posted on Oct 09, 00:30 UTC

Finished:  Code update finished, no significant issues occurred over the course. IP Geolocation and Device Detection are fully functional again. 
- Posted on Oct 10, 10:55 UTC

Scheduled: Planned update to Contact Enrichment Services server code for improving solution stability and prepare for further functionality extension. Affected services: IP Geolocation, Device Detection Impact on customers: GeoIP/Device Detection customers might face brief connectivity issues but no major impact is predicted 
- Posted on Oct 04, 05:33 UTC

  Oct 09, 2017

Deployment - Managed Cloud Core Update

Impact: no impact expected.
- Posted on Oct 09, 11:00 UTC

Finished: Managed Cloud Core services update finished successfully.

- Posted on Oct 09, 13:48 UTC

  Oct 06, 2017

Sitecore xDB Cloud Core services Upgrade

<p> <strong> xDB cloud Llama core services upgraded </strong> </p>

<p>

The deployment on to the production is completed successfully & Llama core services upgraded.

Post deploy validations passed positively.

</p>

 


- Posted on Oct 03, 00:30 UTC

  Oct 04, 2017

Sitecore Azure Marketplace API & SPA Update

<p> Sitecore Cloud Operations team is preparing the following planned release to Sitecore Cloud Services. </p>

<p><strong> Affected Sitecore Cloud Service:  </strong> Sitecore Azure Marketplace API and SPA Endpoints. </p>

<p><strong>  Release summary</strong>   </p>

<p>  Sitecore Azure Marketplace API ver. API 1.0.0 rev. 310  and Marketplace SPA 1.0.0 rev. 361  are the full release product packages. </p>

<p>  This release includes below features, improvements & highlights: </p>

 <br>

  1.  [Bug Fix] Version endpoint returns empty if publishingDate format is wrong
  2.  Adding time zone support for publishingDate (e.g. “19/09/2017 01:30:42 PM +08:00”)
  3.  [Microsoft issue] Update 8.2.x ARM & WDP in Marketplace
  4.  Adding Support for non-string values in metadata
  5.  [Bug Fix] Certificate (upload existing) password validation warning does not disappear upon lose focus
  6.  Added support for non-string values in metadata
  7.  Label/info message changes for certificate generation

<br>

<p><strong>   Expected impact on customers:  </strong>  No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.  </p>


- Posted on Oct 03, 00:30 UTC

Deployment Done: 

<p>Both the  Sitecore Azure Marketplace API & SPA have been upgraded to the latest release packages - API 1.0.0 rev. 310 & SPA 1.0.0 rev. 361 </p>

<p> This completes this deployment successfully </p>


- Posted on Oct 04, 11:37 UTC

  Oct 03, 2017

xDB Cloud - MongoDB updates to 3.0

Following MongoDB 2.6 end-of-life announcement, Sitecore is planning to upgrade all xDB Cloud sets using MongoDB 2.6 to nearest supported version, MongoDB 3.0 MMAPv1. This action helps keeping xDB Cloud environments stable and fully supported.

The MongoDB upgrade scheduled for 30-Sep-2017.

Impact and required actions

Upgrading MongoDB server will not cause any changes, downtime or service degradation for connected Sitecore solution.

Before upgrade is executed, we ask you to ensure one of the following criteria applied to your Sitecore environment:

  1. Sitecore environment runs Sitecore XP 8.0 Update-5 or later. These versions use later Mongo C# driver and fully compatible with MongoDB 3.0
  2. Sitecore environment running Sitecore XP 7.5 Initial Release – 8.0 Update-4 has hotfix 126216 applied on all Sitecore instances. Contact Sitecore Support to request the hotfix
Additional information is available in the Sitecore Knowledge Base: https://kb.sitecore.net/articles/920798
- Posted on Sep 30, 00:30 UTC

Maintenance Status - Completed on Oct 2: Sitecore has completed the upgrade of all xDB Cloud sets using MongoDB 2.6 to nearest supported version, MongoDB 3.0 MMAPv1. There were no reported downtime's and services run smoothly with the new MongoDB driver version.&nbsp;
- Posted on Oct 03, 10:46 UTC

Scheduled: 

Following MongoDB 2.6 end-of-life announcement, Sitecore is planning to upgrade all xDB Cloud sets using MongoDB 2.6 to nearest supported version, MongoDB 3.0 MMAPv1. This action helps keeping xDB Cloud environments stable and fully supported.

The MongoDB upgrade scheduled for 30-Sep-2017. Estimate time frame for migration is couple of days, should be finished till 06-Oct-2017.

Additional information is available in the Sitecore Knowledge Base: https://kb.sitecore.net/articles/920798.


- Posted on Sep 19, 15:30 UTC

  Sep 23, 2017

IP Geo and Device Detection - Server Code Update

Planned update to Contact Enrichment Services server code for improving solution stability and prepare for further functionality extension.

Affected services: IP Geolocation, Device Detection

Impact on customers: GeoIP/Device Detection customers might face brief connectivity issues but no major impact is predicted


- Posted on Sep 23, 06:45 UTC

Finished: Code update finished, no significant issues occurred over the course. IP Geolocation and Device Detection are fully functional again.
- Posted on Sep 23, 10:00 UTC

Started: Code update started.
- Posted on Sep 23, 06:45 UTC

Scheduled: 

Planned update to Contact Enrichment Services server code for improving solution stability and prepare for further functionality extension.

Affected services: IP Geolocation, Device Detection

Impact on customers: GeoIP/Device Detection customers might face brief connectivity issues but no major impact is predicted


- Posted on Sep 23, 04:00 UTC

  Sep 22, 2017

Sitecore Azure Marketplace API & SPA Update

Sitecore Cloud Operations team is preparing the following planned release to Sitecore Cloud Services.

Affected Sitecore Cloud Service:  Sitecore Azure Marketplace API and SPA Endpoints.

Release summary:   

Sitecore Azure Marketplace API ver. API 1.0.0 rev. 297 and Marketplace SPA 1.0.0 rev. 346 are the full release product packages.

This release includes below features, improvements & highlights:

  1.  Added support for uploading and generating certificates for authentication to be used in Sitecore 9.0.0
  2.  Added support for Visibility flag and Publishing Date for any product’s version
  3.  Introduced Web API and Metadata versioning
  4.  Improved SPA’s communication services to better support multiple requests, with different timeout/retry settings using HttpQueues
  5.  Added SKU Size array to support any size naming for products and not only numeric ranges.

Expected impact on customers:   No impact expected, but Sitecore Settings page may be unavailable in Azure Marketplace for a short period during production switch.


- Posted on Sep 19, 07:06 UTC

  Sep 22, 2017

xDB Cloud Update - Sitecore 8.2 Update-5 availability

xDB Cloud services planned upgrade scheduled on September 20, 2017. Added support of Sitecore 8.2 Update 5. No impact on existing customers expected.


- Posted on Sep 20, 11:00 UTC

Finished: xDB Cloud services upgrade finished successfully.
- Posted on Sep 22, 13:03 UTC

Update 3: 

xDB Cloud services upgrade is in progress. No impact on existing customers expected.


- Posted on Sep 22, 08:34 UTC

Update 2: Due to technical reasons we decided to postpone deployment till September 22.
No impact on customers.
- Posted on Sep 20, 13:59 UTC

Update 1: 

xDB Cloud services planned upgrade scheduled on September 20, 2017. Added support of Sitecore 8.2 Update 5. No impact on existing customers expected.


- Posted on Sep 20, 13:54 UTC

  Sep 15, 2017

SSL certificate issue with multiple Sitecore Cloud services

SSL Certificate of all Sitecore cloud services expired on 15-Sep-2017. Update of certificate has been performed before the date, however, configuration was not applied properly for multiple resources.

This caused an outage on various Sitecore services such as IP Geolocation, Device Detection, Email Cloud and Sitecore Azure Marketplace.

Customers were not able to connect the services until the certificate is renewed.


- Posted on Sep 15, 18:14 UTC

Issue Resolved: 

Certificates have been updated for all the affected services (Email Cloud, IP Geo Location and Device Detection).

No further impact on any customers expected.


- Posted on Sep 15, 19:33 UTC

Issue resolved for marketplace: Issue has been addressed for Sitecore Azure Marketplace service
- Posted on Sep 15, 16:05 UTC

Issue identified: 

SSL Certificate of all Sitecore cloud services expired on 15-Sep-2017. Update of certificate has been performed before the date, however, configuration was not applied properly for multiple resources. This caused an outage when Sitecore solutions were communicating to those services.

Services affected by outage: IP Geolocation, Device Detection, Email Cloud and Sitecore Azure Marketplace.

Impact: Customers are not able to connect the services until the certificate is renewed.

Next steps: Cloud Ops urgently started configuration update to ensure only new certificate is used


- Posted on Sep 15, 16:00 UTC

  Aug 30, 2017

xDB Cloud core services planned upgrade

xDB Cloud core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Aug 30, 11:00 UTC

Update 2: This upgrade process had been completed now.
- Posted on Aug 30, 18:30 UTC

Update 1: We are starting update xDB Core Production environment. No impact on provisioning function expected.
- Posted on Aug 30, 14:00 UTC

Scheduled: xDB Core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Aug 30, 13:00 UTC

  Aug 24, 2017

Deployment - Managed Cloud Core Update Release 1.3

Sitecore Cloud Operations team is preparing the following planned release to Sitecore Could Services.

Affected Sitecore Cloud Service: Managed Cloud

Release summary: internal enhancements of Managed Cloud registry database (Managed Cloud Core)

Impact on Customers: No downtime and no impact on live customer solutions expected.

Reference Numbers: 149728


- Posted on Aug 23, 16:00 UTC

Deployment Status: Deployment Completed and Tested On Pre-Production and Production
- Posted on Aug 24, 10:13 UTC

  Aug 22, 2017

Managed Cloud - Resources access issue via Azure Portal

azure.microsoft.com was unavailable between 23:59 UTC on 21 Aug 2017 and 00:42 UTC on 22 Aug 2017, so Sitecore Managed Cloud customers might have experienced errors while accessing https://azure.microsoft.com or Azure Portal of respective subscriptions

Full details at https://azure.microsoft.com/en-us/status/history/.


- Posted on Aug 21, 23:30 UTC

Alert: 

azure.microsoft.com was unavailable between 23:59 UTC on 21 Aug 2017 and 00:42 UTC on 22 Aug 2017, so Sitecore Managed Cloud customers might have experienced errors while accessing https://azure.microsoft.com or Azure Portal of respective subscriptions

Full details at https://azure.microsoft.com/en-us/status/history/.


- Posted on Aug 22, 01:00 UTC

  Aug 11, 2017

Marketplace Upgrade - API 1.0.0 rev. 228 and SPA 1.0.0 rev. 282 released


- Posted on Aug 11, 10:00 UTC

Scheduled: Marketplace Core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Aug 11, 10:00 UTC

Update 1: We are starting update Marketplace Production environment. No impact on provisioning function expected.
- Posted on Aug 11, 06:55 UTC

  Aug 04, 2017

Page Preview Service Down

During daily monitoring activities, we have observed & verified that the Page Preview service is down.

This is most likely due to vendor API being down as pointed by internal Sitecore monitoring system. Investigation started in collaboration with vendor (Litmus).


- Posted on May 16, 00:00 UTC

Alert Closed: 

Sitecore decided to officially deprecate and turn off the service.

The service now hidden from App Center UI production, so new activation is no longer possible. 

Existing customer will receive detailed information on further steps shortly over e-mail.


- Posted on Aug 04, 11:26 UTC

Reported: 

During daily monitoring activities, we have observed & verified that the Page Preview service is down.

This is most likely due to vendor API being down as pointed by internal Sitecore monitoring system. Investigation started in collaboration with vendor (Litmus).


- Posted on May 17, 12:36 UTC

  Aug 04, 2017

xDB Cloud 1.0-2.0 - SQL issues impacting xDB Cloud reporting functionality

According to Azure Status report (https://azure.microsoft.com/en-us/status/history), some Azure SQL services in West US region were experiencing intermittent issues with connectivity. The issue occurred between 10:15 UTC on 03 Aug 2017 and 04:15 UTC on 04 Aug 2017.

Potentially affected Sitecore Customers: xDB Cloud 1.0, xDB Cloud 2.0 customers with sets in West US region

Potential Impact: customers may not be able to view reports or reports may appear slower than usual. Customer’s content delivery was not affected at all.

 


- Posted on Aug 03, 22:00 UTC

Alert: 

According to Azure Status report (https://azure.microsoft.com/en-us/status/history), some Azure SQL services in West US region were experiencing intermittent issues with connectivity. The issue occurred between 10:15 UTC on 03 Aug 2017 and 04:15 UTC on 04 Aug 2017.

Potentially affected Sitecore Customers: xDB Cloud 1.0, xDB Cloud 2.0, Managed Cloud customers with sets in West US region

Potential Impact: customers may not be able to view reports or reports may appear slower than usual. Customer’s content delivery was not affected at all.

Mitigation: Microsoft Azure engineers have resolved the issue on 04 Aug 2017, 04:15 UTC.


- Posted on Aug 04, 10:00 UTC

  Aug 03, 2017

App Center Update - Release 0.266 and 0.271

Sitecore Cloud Operations prepares the following update to production Sitecore Service Offering:

Start Date:  24-Jul-2017, 04:00 UTC

Planned Finish Date: 31-Jul-2017, 11:00 UTC

Update Description: Bug fixes for the new SPEAK UI in Sitecore 9.0 and for the Management portal (Orders.aspx)

Impact on Customers:  No impact on live customer solutions expected, App Center server will be restarted once closer to finish date.

Release Notes:

Version Info: Release 0.266.0 (Framework) and Release 0.271.0 (Management).

  • App Center UI for Sitecore 9.0 (SPEAK) fixes
  • Bug 149442: Orders.aspx not loading correct lines

- Posted on Jul 24, 11:00 UTC

Completed: The Sitecore App center has been successfully updated with the release packages - 0.271 & 0.272 which include the Bug fixes for the new SPEAK UI in Sitecore 9.0 and for the Management portal (Orders.aspx) 
- Posted on Aug 03, 05:37 UTC

Maintenance Status:  Bug fixes for the new SPEAK UI in Sitecore 9.0 and for the Management portal (Orders.aspx)
- Posted on Aug 03, 05:34 UTC

  Jul 25, 2017

xDB Cloud core services planned upgrade


- Posted on Jul 25, 10:00 UTC

Completed: Core services upgrade completed
- Posted on Jul 25, 11:48 UTC

Scheduled: xDB Cloud core services planned upgrade scheduled. No downtime or impact expected.
- Posted on Jul 25, 09:07 UTC

  Jul 18, 2017

App Center Update

App Center has been updated with a security hotfix, details are described in KB article https://kb.sitecore.net/articles/978654
- Posted on Jul 18, 09:08 UTC

  Jul 10, 2017

xDB Cloud Customers Update

As part of stability improvements to cloud platform, we are delivering a codebase update to all Sitecore xDB Cloud users within the next week: 06-11 July 2017

The recent hotfix from Security Bulletin SC2017-001-170504 has been included in the codebase update.


- Posted on Jul 06, 10:00 UTC

Update 5: All customers on Sitecore version 8.2 were updated successfully.
- Posted on Jul 10, 15:09 UTC

Update 4: All customers on Sitecore version 8.1 Update 3 were updated successfully.
- Posted on Jul 07, 14:08 UTC

Update 3: All customers on Sitecore version 8.1 Update 2 were updated successfully.
- Posted on Jul 07, 09:44 UTC

Update 2: All customers on Sitecore version 8.1 Update 1 were updated successfully.
- Posted on Jul 06, 16:59 UTC

Update 1: All customers on Sitecore version 7.5 and 8.5 were updated successfully.
- Posted on Jul 06, 09:07 UTC

Scheduled: 

As part of stability improvements to cloud platform, we are delivering a codebase update to all Sitecore xDB Cloud users within the next week: 06-11 July 2017

The recent hotfix from Security Bulletin SC2017-001-170504 has been included in the codebase update.


- Posted on Jul 05, 10:00 UTC

  Jun 27, 2017

Email Delivery Alert triggered


- Posted on Jun 27, 20:11 UTC

Restored: Investigation complete, no effect on Sitecore Email Delivery service found.
- Posted on Jun 27, 22:00 UTC

Identified: Internal Sitecore monitoring system identified an alert with Email Delivery for EXM 1.0 - 3.3 (Dyn) service. The timing of incident correlated with Dyn report on DNS API degradation, while this service does not directly affects EXM functionality. Investigation started
- Posted on Jun 27, 20:11 UTC

  Jun 21, 2017

Email Cloud - Intermittent unavailability (planned)

On 21 June, Sitecore Email Cloud delivery provider (Sparkpost) will be executing maintenance.

This maintenance may cause intermittent REST API availability, which may affect certain operations for Sitecore Email Experience (3.4 +) customers using Email Cloud service.

Email dispatching will not be affected.


- Posted on Jun 21, 19:00 UTC

Completed: 

Provider reports successful maintenance completion. Feel free to contact Sitecore Support (https://support.sitecore.net) in case of any issues noted.


- Posted on Jun 21, 21:20 UTC

Back to schedule Started: 

As reported by our email provider, the maintenance is now set to begin on 21-Jun-2017 at 7pm UTC time. This will not cause immediate service degradation, but API calls failures may occur. As planned, email delivery is not affected in any way.


- Posted on Jun 21, 19:00 UTC

Postponed: 

Maintenance postponed until 23 June 2017. Further updates will be posted closer to maintenance date.


- Posted on Jun 20, 07:05 UTC

Scheduled: 

On 19 June, Sitecore Email Cloud delivery provider (Sparkpost) will be executing maintenance.

This maintenance may cause intermittent REST API availability, which may affect certain operations for Sitecore Email Experience (3.4 +) customers using Email Cloud service.

Email dispatching will not be affected.


- Posted on Jun 17, 09:18 UTC

  Jun 20, 2017

Email Delivery for EXM 1.0 - 3.3 service degradation

Due to API Degradation reported by Dyn, underlying email vendor of Sitecore Email Delivery for EXM 1.0 - 3.3 service, some features of EXM 1.0 - 3.3 using Sitecore MTA might not be available. Email dispatching is not affected by this issue.

More details on Dyn Status Page: https://www.dynstatus.com/incidents/1zb4n5qxvn51


- Posted on Jun 18, 11:40 UTC

Restored: 

According to the vendor, Email API is restored, so all systems related to Email Delivery for EXM 1.0 - 3.3 are functioning again.


- Posted on Jun 20, 07:02 UTC

Identified: 

Due to API Degradation reported by Dyn, underlying email vendor of Sitecore Email Delivery for EXM 1.0 - 3.3 service, some features of EXM 1.0 - 3.3 using Sitecore MTA might not be available. Email dispatching is not affected by this issue.

More details on Dyn Status Page: https://www.dynstatus.com/incidents/1zb4n5qxvn51


- Posted on Jun 18, 13:53 UTC

  Jun 04, 2017

App Center Maintenance

App Center will be down for regular maintenance.


- Posted on Jun 04, 07:00 UTC

App Center Maintenance Completed: 

App Center Maintenance was finished. All Services are working as expected.

Delivered changes: Email Preview and Spam Check apps are no longer available for purchase via App Center (regional office should be contacted from now on), also some background fixes in the system.


- Posted on Jun 04, 07:56 UTC

  May 23, 2017

App Center with Multiple Services were temporarily down

During daily monitoring activities, we have observed & verified that following services were down :

 

Page Preview service – Litmus

Spam Check – Litmus

Email Preview – Litmus

CRM connections 


- Posted on May 23, 01:00 UTC

Closure Root Cause Analysis: 

Upon investigation, it was found that hard disk to the server hosting App Center VM had crashed. After contacting infrastructure team, we found that the VM didn’t start properly after hard disk replacement. A proper reboot solved the Issue. The Services are back to normal except Page Preview (see active maintenance for status).


- Posted on May 23, 10:15 UTC

Identified and resolved: 

During daily monitoring activities, we have observed & verified that following services were down:

    • Page Preview
    • Spam Check
    • Email Preview
    • Email Delivery for EXM 1.0 – 3.3 
    • App Center UI 

Customer Impact 

App Center users not able to use App Center and face errors upon accessing. Thus not being able to access all the above services as well.

Details

All of the services listed above were down from 01:00 AM – 04:55 AM UTC. The incident was fixed upon determination with help of infrastructure team. Root cause analysis is on-going, results will be posted later


- Posted on May 23, 10:14 UTC

  May 12, 2017

IP Geolocation - Inability to view consumption data

Customers are not able to see IP Geolocation consumption data for May 2017


- Posted on May 11, 00:00 UTC

Restored: 

Consumption data reports restored for IP Geolocation service, no further issues. Sitecore is monitoring the system state after fix application. Also, an additional level of monitoring will be implemented for faster service restoring in future.


- Posted on May 12, 12:27 UTC

Identified: 

Sitecore Cloud Operations team have identified an issue with the following details:

Sitecore Cloud Service: Sitecore IP Geolocation

Impact: All service customers are not able to view IP Geolocation consumption data for May 2017 in Sitecore App Center

Status & Next-Steps: Sitecore team is actively working on restoring the consumption view feature. Next update will be provided within this thread on issue resolution.


- Posted on May 11, 12:52 UTC

  May 04, 2017

App center DB server Issue : unable to remote login to App center Database server

During daily monitoring activities Sitecore Cloud Operations team have identified an issue with one of the App Center server.

 

Customer Impact :          Short/very few minutes downtime expected for all customers

 

Details:

 

              Today we have identified that the remote login to the App center Database server has been failing.

               As of now, All App center operations are working fine & customer endpoints working normal, only the backend login to the server is not possible for now.

              We believe some processes on the server might be stalled for which the server restart would be needed.

              We are working with the IT team to resolve this issue. 

The Database server will be restarted by the Sitecore IT team now.

The App center will have a downtime of appx. 5 - 10 minutes for all customers


- Posted on May 04, 09:20 UTC

Login to App center Database server now possible: 

This maintenence is now completed after the DB server was restarted.

All app center services are up & running & we have smoke tested the customer facing apps to be positive.

The downtime was approximately 5 minues.


- Posted on May 04, 09:20 UTC

  Apr 12, 2017

App Center Login issue

All Sitecore customers when trying to log into App Center UI will see an error.

All purchased App Center services are running well.


- Posted on Apr 12, 12:00 UTC

Restored: 

Service is restored, login functionality works again.

Team is working on root cause analysis now.


- Posted on Apr 12, 12:59 UTC

Identified: 

On 12-Apr-2017, 10:00 UTC issue with login functionality has occurred.

Impact:

All Sitecore customers when trying to log into App Center UI will see an error.
All purchased App Center services are running well.

Our team will continuously work to investigate the issue and find a workaround.


- Posted on Apr 12, 12:37 UTC

  Apr 11, 2017

xDB Cloud - Planned Service Maintenance

482298 - [Deployment] OT Migration - updated changes with support of moving Search and SqlDB is ready for deployment


- Posted on Apr 11, 14:40 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Apr 11, 12:45 UTC

IN PROGRESS: 

xDB Cloud Сore services planned upgrade


- Posted on Apr 11, 11:42 UTC

  Apr 04, 2017

App Center Shop is temporary unavailable

App Center Shop is temporary unavailable.

After restart of CRM, service is back online.


- Posted on Apr 04, 08:00 UTC

RESOLVED: 

App Center UI access is now working fine, issue resolved.


- Posted on Apr 04, 08:57 UTC

IN PROGRESS: 

App Center UI is temporary unavailable due to underlying internal service went down. Customers are not able to make new purchases in the meantime. Sitecore team is working on restoring the service.

All purchased applications are running normal


- Posted on Apr 04, 08:28 UTC

  Mar 17, 2017

xDB Cloud - Planned Service Maintenance

Core services upgrade - Cloud[#481335]


- Posted on Mar 17, 16:00 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Mar 17, 16:19 UTC

IN PROGRESS: 

xDB Cloud Сore services planned upgrade


- Posted on Mar 17, 15:12 UTC

  Mar 17, 2017

App Center Maintenance

App Center will be down for regular Maintenance. 


- Posted on Mar 24, 11:00 UTC

App Center down for Maintenance: 

App Center will be down for the next 10 min.


- Posted on Mar 17, 10:33 UTC

App Center up and running: 

Regular Maintenance was performed on the App Center. Down Time was next 10 min.


- Posted on Mar 17, 10:23 UTC

  Mar 06, 2017

xDB Cloud - Planned Service Maintenance

xDB Cloud Сore services planned upgrade


- Posted on Mar 06, 18:00 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Mar 06, 18:21 UTC

SCHEDULED: 

xDB Cloud Сore services planned upgrade


- Posted on Mar 06, 15:52 UTC

  Mar 03, 2017

App Center Facing TimeOut Issue

Issues been discovered in the morning 03-Mar-2017 with CRM auxiliary used by App Center which can cause customers facing time out issue while logging in to App Center. Operations Team is working to back system on track.


- Posted on Mar 03, 04:00 UTC

UI TimeOut Issue resolved: 

Issue were  discovered with CRM auxiliary service used by App Center. Consecutively App Center Web Interface was non responsive. All service (Email Delivery etc.) were working as usual. The Issue was Identfied and was resolved.


- Posted on Mar 03, 11:16 UTC

ISSUE DISCOVERED AND IN PROGRESS: 

Issue has been discovered in the morning 03-Mar-2017 with CRM auxiliary service used by App Center which can cause customers facing time out issue while logging in to App Center. Operations Team is working to get back system on track.


- Posted on Mar 03, 07:35 UTC

  Mar 01, 2017

xDB Cloud - Planned Service Maintenance

SCHEDULED

xDB Cloud Сore services planned upgrade to deliver support for Sitecore 8.2 Update 1 and SItecore 8.2 Update 2.

Impact on existing customers: no impact


- Posted on Mar 01, 17:00 UTC

FINISHED: 

Upgrade completed successfully.


- Posted on Mar 01, 16:06 UTC

SCHEDULED: 

xDB Cloud Сore services planned upgrade to deliver support of Sitecore 8.2 Update 1 and SItecore 8.2 Update 2.

Impact on existing customers: no impact


- Posted on Mar 01, 15:40 UTC

  Feb 23, 2017

App Center Maintenance

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) on23-Feb-2017 Impact: no impact expected


- Posted on Feb 23, 09:00 UTC

FINISHED: 

Maintenance completed successfully.


- Posted on Feb 23, 19:56 UTC

Initialization: 

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) on 23-Feb-2017 .Impact: no impact expected.


- Posted on Feb 23, 19:53 UTC

  Feb 21, 2017

xDB Cloud 1.0 outage in Australia

Outage has been discovered in the late 20-Feb-2017. Only xDB Cloud 1.0 customers in Australia Southeast are affected. Ops team works on solution.


- Posted on Feb 21, 00:00 UTC

Issues Resolved: 

Solution applied resolved the issue completely (confirmed).


- Posted on Feb 21, 13:17 UTC

Solution Applied: 

All Australia xDB Cloud 1.0 sets are reachable now. Ops team monitors the health now


- Posted on Feb 21, 08:22 UTC

Issue Discovered and In Progress: 

Outage has been discovered in the late 20-Feb-2017. Only xDB Cloud 1.0 customers in Australia Southeast are affected. Ops team works on temporary workaround and root cause.


- Posted on Feb 21, 07:28 UTC

  Feb 07, 2017

Continuous App Center Maintenance

After recent App Center Update, Sitecore App Center sometimes fail to log in. Operations Team is working to back system on track.


- Posted on Jan 10, 00:00 UTC

Resolved: 

This Issue of inability to login to App center has now been fixed.  A new fix to remediate this issue has been deployed on the App center.

It's been verified since then that the authentication to the App center works fine & no downtime caused for the end users/customers login to the App center.


- Posted on Feb 07, 05:05 UTC

Interim Workaround: 

There is an interim workaround available to fix any App Center login issue. Reach out to Sitecore Support (https://support.sitecore.net) with reference ID 143243 to request workaround applied.

Work on permanent fix is continued.


- Posted on Jan 17, 15:41 UTC

In Progress: 

After recent App Center Update (finished 10-Jan-2017), Sitecore App Center sometimes fail to authenticate users. Therefore, some customers may not be able to log into App Center.

Impact: interim inability to log into App Center. All service (Email Delivery etc.) are working as usual.

Actions: Operations Team is working to back system on track.


- Posted on Jan 14, 13:07 UTC

  Jan 10, 2017

App Center Maintenance

During the weekend, Sitecore Cloud Operations will be updating App Center codebase.

No impact on production users expected, but we encourage customers not to perform any App Center actions during the period of maintenance.


- Posted on Jan 07, 00:00 UTC

Finished: 

App Center Update has been finished on 10-Jan-2017, 16:00 UTC. All App Center features work properly.


- Posted on Jan 10, 20:27 UTC

Maintenance Continued: 

App Center maintenance took more time than expected. Activities will be continued during 10-Jan-2017. Current expectations to finish maintenance: 11-Jan-2017.

Notes: new customers may not have the ability to access App Center until maintenance end.


- Posted on Jan 09, 20:08 UTC

Temporary Login Issues: 

During 08-Jan-2017, starting 07:30 AM UTC App Center reported an issue with the ability for Sitecore customers to log into App Center UI. This has been fixed at 11:30 AM. Maintenance continued.


- Posted on Jan 08, 11:37 UTC

Scheduled: 

During the weekend, 07-Jan to 09-Jan, Sitecore Cloud Operations will be updating App Center codebase.

No impact on production users expected, but we encourage customers not to perform any App Center actions during the period of maintenance.


- Posted on Jan 06, 08:18 UTC

  Jan 04, 2017

xDB Cloud - Planned Service Maintenance

SCHEDULED

xDB Cloud Discovery and related core services DNS maintenance.

Impact on existing customers: no impact


- Posted on Jan 04, 14:30 UTC

FINISHED: 

Maintenance completed successfully.


- Posted on Jan 04, 16:13 UTC

SCHEDULED: 

xDB Cloud Discovery and related core services DNS maintenance.

Impact on existing customers: no impact


- Posted on Jan 04, 14:24 UTC

  Dec 24, 2016

xDB Cloud - Planned Service Update

Introducing support of 8.2 Initial release for xDB Cloud 2.0 service. New customers will be able to request xDB Cloud 2.0 set for Sitecore 8.2 Initial Release.

Impact on existing customers: no impact


- Posted on Dec 22, 00:00 UTC

Finished: 

Codebase updated, Sitecore 8.2 is now available to provision on new xDB Cloud 2.0 sets.


- Posted on Dec 24, 22:52 UTC

Scheduled: 

Core service update scheduled for deploying new service features.

Impact on existing customers: no impact


- Posted on Dec 21, 23:21 UTC

  Dec 16, 2016

App Center Maintenance

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) during 05-Dec-2016 - 08-Dec-2016 timeframe.

Impact: no impact expected.


- Posted on Dec 05, 00:00 UTC

Done: 

All deployment activities finished


- Posted on Dec 16, 14:15 UTC

Still in progress Delayed: 

App Center switch was postponed, so anticipated production switch will occur 13-14 December. No impact on customers expected.


- Posted on Dec 13, 08:01 UTC

Initialization: 

Sitecore Cloud Operations will be updating production App Center service and related apps (Email Delivery, Spam Check etc.) during 05-Dec-2016 - 08-Dec-2016 timeframe.

Impact: no impact expected.


- Posted on Dec 01, 13:29 UTC

  Dec 13, 2016

xDB Cloud - Updating Processing and Reporting services

For all xDB Cloud customer, Sitecore Cloud Operations team is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

No downtime and no impact expected.


- Posted on Dec 08, 00:00 UTC

Done: 

Maintenance finished. No issues occurred.


- Posted on Dec 13, 15:12 UTC

In Progress: 

For xDB Cloud customers, Sitecore Cloud Operations is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

No downtime and no impact on live Sitecore solutions expected.


- Posted on Dec 08, 08:07 UTC

  Dec 02, 2016

xDB Cloud 1.0 Discovery Service incident

Cloud Operations identified an issue with interim unresponsiveness of Discovery Service in Europe


- Posted on Dec 01, 00:00 UTC

Resolved: 

RCA completed and further action for improving stability were taken.

System is fully restored.


- Posted on Dec 02, 10:04 UTC

Incident Fixed: 

Cloud Operations team took broken node out of production, so Discovery service is fully functional now. Root cause analysis in progress


- Posted on Dec 01, 15:55 UTC

Issue Identified: 

During daily monitoring activates of xDB Cloud service, following issue with xDB Cloud was identified:

Issue Description: One of the nodes behind discovery service was in unresponsive state, causing some of requests to https://discovery-xdb-cloud.sitecore.net to fail

Customers affected: potentially, all xDB Cloud 1.0 customers (mostly, European xDB Cloud 1.0 customers) who re-connected to xDB Cloud during issue time frame

Time frame: 01-Dec-2016 07:00 AM UTC – 01-Dec-2016 1:00 PM UTC

Possible Impact on customer’s solution: when starting Sitecore solution connected to xDB Cloud 1.0, solution may fail to connect xDB Cloud and get connection strings


- Posted on Dec 01, 15:55 UTC

  Nov 29, 2016

xDB Cloud - Core Maintenance

General maintenance on xDB Cloud Core Services for stability improvement.

No impact on xDB Cloud customer sets. More details on dev.sitecore.net.


- Posted on Nov 28, 00:00 UTC

Updated: 

General maintenance on xDB Cloud Core Services for stability improvement.

No impact on xDB Cloud customer sets. More details on dev.sitecore.net.


- Posted on Nov 29, 21:43 UTC

  Oct 23, 2016

Interim issue accessing Sitecore Cloud services due to DNS

Issue due to DDoS attack on our DNS provider, DynDNS:

https://www.dynstatus.com/incidents/5r9mppc1kb77


- Posted on Oct 21, 10:00 UTC

Summary: 

On 21-Oct-2016, our DNS service provider reported an issue of temporary DNS unavailability. More details available on provider page.

Impact: during daily monitoring, Sitecore's Cloud Operations indicated a very few instances of unavailability of our services like xDB Cloud Discovery Service (used in xDB Cloud 1.0) and App Center services for short period of times during 21-Oct.

Resolution: all systems fully available and stable since 22-Oct.


- Posted on Oct 23, 18:16 UTC

  Oct 21, 2016

App Center Update

Over the week, Sitecore Cloud Operations is working on production update of Sitecore App Center.

Impact: possible interriment impact on App Center UI operations


- Posted on Oct 17, 00:00 UTC

Maintenance Finished: 

App Center resources have been successfully updated.


- Posted on Oct 21, 08:19 UTC

Maintenance Started: 

Over the week, Sitecore Cloud Operations is working on production update of Sitecore App Center.

Impact: possible intermittent impact on App Center UI operations


- Posted on Oct 17, 12:37 UTC

  Oct 20, 2016

xDB Cloud - Updating Processing and Reporting services

For various xDB Cloud customer, Sitecore Cloud Oeprations team is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

  • Expected downtime: no downtime
  • Possible impact on Sitecore site connected to xDB Cloud: temporary delay (few minutes) with showing up new data in reports is possible

- Posted on Oct 12, 00:00 UTC

Maintenance Finished: 

All update procedures are finished, no issues occurred during maintenance period.


- Posted on Oct 20, 17:35 UTC

Maintenance In Progress: 

For xDB Cloud customers, Sitecore Cloud Operations team is enrolling update of Processing and Reporting services to improve stability and performance of the xDB Cloud sets.

Impact on Sitecore sites connected to xDB Cloud: no downtime for data collection, temporary delay (a few minutes) for the collected data to show up in reports


- Posted on Oct 12, 06:51 UTC

  Oct 15, 2016

Email Delivery - Intermittent error with purchasing new Email Delivery subscription in App Center

On 11-Oct-2016, Sitecore identified an issue with App Center being unable to process Email Delivery purchases properly.

Any Email Delivery purchase posted starting from 11-Oct-2016 might be affected.


- Posted on Oct 11, 00:00 UTC

Issue resolved: 

On 13-Oct-2016, issue's root cause has been addressed. The error with Email Delivery activation is fixed.


- Posted on Oct 15, 08:10 UTC

Issue Identified: 

On 11-Oct-2016, Sitecore identified an issue with App Center being unable to process Email Delivery purchases properly.

Any Email Delivery purchase posted starting from 11-Oct-2016 might be affected


- Posted on Oct 13, 08:26 UTC

  Oct 12, 2016

App Center Maintenance

Cloud Operations team will perform Maintenance on the Production App Center servers.


- Posted on Sep 20, 21:00 UTC

Done: 

App Center maintenance was finished successfully


- Posted on Oct 12, 06:55 UTC

  May 14, 2016

Dyn Email Delivery Degraded Performance

Our engineers have implemented further network and code improvements, reducing the number of HTTP 500, 502, and 504 responses from both Send API and reporting requests. Additional measures are being worked on and customers should continue to see a decrease in responses as a result. If you are continuing to see HTTP error responses, or timeouts in general, please reach out to our Technical Support Team.

 

http://www.google.com


- Posted on May 14, 09:00 UTC

  May 11, 2016

China Network Latency

customers using our China Network nameservers began to experience issues with latency. Our engineers are aware of the issue. Our transit provider is working on a resolution. We will post updates as they become available. We do not recommend that customers make any changes in their configuration in response to this event. This only affects our mainland China Network nameservers, not our global Anycast network


- Posted on May 11, 09:00 UTC