Sitecore 9.1 – Tag content using Sitecore Cortex Content Tagging

Content Tagging, Sitecore, Sitecore 9.1, , , ,

Sitecore 9.1 introduces Sitecore CortexTM that enables implementation of ML/AI–based technology by any product/customer on experience data in the xDB. In 9.1 it provides Content Tagging Out of Box that tags content items based on the content of the item. The Sitecore Cortex Content Tagging feature integrates the Sitecore CMS with machine learning (ML) based natural language processing (NLP) engines. By default it provides integration with OpenCalais. Open Calais is a sophisticated web service that attaches intelligent metadata-tags to your unstructured content.  The Open Calais natural language processing engine automatically analyzes and tags your input files.

This is how it is configured in Sitecore 9.1:

  • On installing vanilla instance, the “Tag Item” command in group “Content Tagging” on Home ribbon is disabled.

disabledtagcommand

seeapikey

  • Copy the token.
  • Create a patch file “CalaisAccessToken.config” in \App_Config\Include and put this code in it: 

<?xml version=”1.0″ encoding=”utf-8″ ?>

<configuration xmlns:patch=”http://www.sitecore.net/xmlconfig/&#8221; xmlns:role=”http://www.sitecore.net/xmlconfig/role/”&gt;

<sitecore role:require=”Standalone or ContentManagement”>

<settings>

<setting name=”Sitecore.ContentTagging.OpenCalais.CalaisAccessToken”>

<patch:attribute name=”value”>e60LAvbSdDkzdO7VbVG8JprZ0WJnCMBE</patch:attribute>

</setting>

</settings>

</sitecore>

</configuration>

accesstokensetting

  • Now the “Tag Item” command in group “Content Tagging” on Home ribbon is enabled.

enabledtagcommand

  • Started tagging on Home item

tagginginprogress

  • Once it completed, I can see many tags applied to Home item in its Semantics field.

tagsapplied

This is how it works at code level:

  1. Sitecore.ContentTagging.Core.Providers.DefaultContentProvider (implements IContentProvider) Takes the content item (and its subitems) as input and creates the TaggableContent object that contains all the field values of the content item except the fields starting with “__”, that is it contains field values of all user defined fields of the item.
  2. Sitecore.ContentTagging.OpenCalais.Providers.OpenCalaisDiscoveryProvider (implements IDiscoveryProvider) takes TaggableContent object as input and get the tags from OpenCalais webservice and returns a list of TagData objects.
  3. Sitecore.ContentTagging.Core.Providers.DefaultTaxonomyProvider (implements ITaxonomyProvider) takes the list of TagData objects as inputs and create the tags in Sitecore Tag Repository  at ‘/sitecore/system/Settings/Buckets/TagRepository’ and return the list of Tag objects.
  4. Sitecore.ContentTagging.Core.Providers.DefaultTagger (implements ITagger) takes the list of Tag objects as input and add these tags to Semantics field of the content item.

We can create the custom implementation of all these providers to suit our needs which I expect would be the case for most production scenarios. To use another NLP engine instead of OpenCalais, we need to create the specific IDiscoveryProvider for that NLP.

Installing Sitecore 9.1

Sitecore, , ,

Prerequisites

                  Install-SitecoreConfiguration -Path .\Prerequisites.json

  • Changed solr parameters in XP0-SingleDeveloper.ps1 accordingly.
  • xp0-singledeveloper_solrparams
  • Also changed “$SitecoreAdminPassword” in XP0-SingleDeveloper.ps1 from SIF-Default to my password and SQL server parameters.
  • Placed the license file along with configuration files.

Installing in Custom Path

  • I wanted to install in D drive. So added install paths in following config files (taking hint from https://www.brimit.com/blog/installing-sitecore-9-different-location).
    • IdentityServer.json
    • sitecore-XP0.json
    • xconnect-xp0.json
  • I used 3 different paths in the respective files: SitecoreInstallationPath, XConnectInstallationPath, IdentityServerInstallationPath and replaced “Site.PhysicalPath” accordingly in the 3 configs.
  • In XP0-SingleDeveloper.ps1, made these changes:
  • xp0-singledeveloper_paths
  • Paths need to be added in “XP0-SingleDeveloper.json” as well.
  • xp0-singledeveloper

Else you will get this error on running install script.

parameternotfounderror

Running Installation script and the issues I faced

  • Ran the install script

         .\XP0-SingleDeveloper.ps1

  • It prompted for the parameters I had created:

paramspromptThe parameters in  XP0-SingleDeveloper.ps1 should have been named as its being prompted here.

Please note the parameters values cannot include quotes here. It treated quote as part of path itself and failed with this error. “Install-sitecoreconfiguration : Cannot find drive. A drive with the name ‘”D’ does not exist.”

ddriveerror

  • After giving all 3 params, installation started and failed with this error:

solradditionalslasherror

failedtostartserviceerror

  • It was not able to start marketing automation service while installing xConnect. I tried again but this time it failed at msdeploy step itself due to existing DBs. Deleted all DBs already created and started again. The DB issue resolved by deleting existing DBs and it recreated the DBs but kept failing with “failed to start service ‘Sitecore Marketing…….” error.
  • Restarted the system and Ran these commands in powershell after restarting:

Get-Childitem cert:\LocalMachine\root -Recurse | Where-Object {$_.Issuer -ne $_.Subject} | Move-Item -Destination Cert:\LocalMachine\CA

Get-Childitem cert:\CurrentUser\root -Recurse | Where-Object {$_.Issuer -ne $_.Subject} | Move-Item -Destination Cert:\CurrentUser\CA

  • Started the Sitecore installation script. The script ran without error this time.
  • Also had tried following things. Not sure if this also helped finally resolve the issue.
    • Gave permissions to the certificate “sc910.xconnect” for user LocalService in mmc.exe
    • Imported the certificate “sc910.xconnect” in Intermediate Certification authorities for Local Machine in mmc.exe.

INSTALLATION COMPLETED !!! My site was up and running.

It was quite smooth except for “failed to start service ‘Sitecore Marketing…….” error which took some time to resolve.

It now has a “Prerequisites.json” that download and install prerequisites which is a good change from Sitecore 9.0.x. But it does not install Solr.
You need to specify SitecoreAdminPassword in the script else it will generate a random password which will be displayed on screen after installation completes and will also be present in the output file created. Everything else is more or less the same as Sitecore 9.0.x from installation perspective.

Had also received this error: “Invoke-ManageWebsiteTask : The property ‘Value’ cannot be found on this object. Verify that the property exists .” This happened as the “World Wide Web Publishing Service” was not running on my PC. It resolved once I ran the service.

Enhancing Author Experience Using EditFrame in Sitecore 9

EditFrame, Sitecore, , ,

Enabling Experience Editor for authors for all their tasks makes for great author experience in Sitecore. Though this is straightforward for simple fields like Rich Text, Date and Time, it is not straightforward for complex fields like Treelist, Multilist etc. “EditFrame” is the way to achieve this. It is very easy to configure as I discovered with a simple example described below.

Enable Editing of a treelist field from Experience Editor in Sitecore 9:

  • Created a template Product with fields as shown in the image.

ProductTemplate

  • Created StandardValues of template and inserted $name in Name field. 
  • Created a MVC layout in Sitecore at “/sitecore/layout/Layouts/Foundation/Products” and physical file at “<webroot>\Views\Products\MVC Layout.cshtml” (Creating in “<webroot>\layout” folder was giving error as namespaces were missing which are present in web.config in Views folder). No edit was required on the file.
  • Created a View Rendering “ProductRendering” in Sitecore at “/sitecore/layout/Renderings/Foundation/Products” and the Product.cshtml file at “<webroot>\Views\Products\ “.
  • Copy this code in Product.cshtml

@using Sitecore.Mvc

@using Sitecore.Mvc.Presentation

@using Sitecore.Mvc.Extensions

@model RenderingModel

@Html.Sitecore().Field(“Name”)

@Html.Sitecore().Field(“Description”)

@Html.Sitecore().Field(“Image”)

<h3>Related Products</h3>

@{

Sitecore.Data.Fields.MultilistField relProdField = Model.Item.Fields[“Related Products”];

}

@using (Html.EditFrame(Model.Item.Paths.FullPath, “ProductTests”, “Related Products”, “Edit Related Products”, null, null))

{

<ul>

@{

foreach (Sitecore.Data.Items.Item relProd in relProdField.GetItems())

{

<li>@relProd.Name</li>

}

}

</ul>

}

  • Enclose the code you want the edit toolbar to appear for in using block for Html.EditFrame as in code above.
  • Created EditFrame button in Core DB.

EditFrameButtonDefinitionInCoreDB

 

  • In StandardValues of Product Template, entered presentation details as follows:

 

  • PresentationDetails

 

  • Created a Products folder at sitecore/content/Home item and created 3 product items prod1, prod2, and prod 3. 

 

  • Opened Prod1 item in Experience Editor , when hovered over Related Products in Experience Editor now, it showed toolbar with the button. This tool bar appears only when Experience Editor is in Editing mode. It does not appear in Designing mode.
  • EditFrameInAction
  • On clicking button, this popup appeared. You can now edit RelatedProducts from Experience Editor itself.
  • EditFrameInAction1

Issues Encountered and their resolutions:

  • Error: ‘System.Web.Mvc.HtmlHelper’ has no applicable method named ‘EditFrame’ but appears to have an extension method by that name. Extension methods cannot be dynamically dispatched. Consider casting the dynamic arguments or calling the extension method without the extension method syntax.
    • Solution: Defining model on top of view is imp. I had not added @model RenderingModel on the view. It got resolved when this was added.
  • The second argument of Html.EditFrame needs to be the folder name under EditFrameButtons in Core DB and not the EditFrameButton item. It did not give any error but the edit button did not appear on the toolbar in Experience Editor.
    • Html.EditFrame(Model.Item.Paths.FullPath, “ProductTests“, “Related Products”, “Edit Related Products”, null, null)
  • Error: Inner Exception: Field editor menu item /sitecore/content/Applications/WebEdit/Edit Frame Buttons/ProductTests/EditComplexFields has empty ‘Fields’ field.
    • Solution: Entered fields name Related Products in Fields.

 

Sitecore 9 – XMSingle topology deployment on Azure PaaS with ARM templates

Sitecore, , ,

Prerequisites:

Deployment:

Followed the steps given here for deploying: https://doc.sitecore.net/sitecore_experience_platform/setting_up_and_maintaining/sitecore_on_azure/deploying/walkthrough_deploy_a_new_sitecore_environment_to_the_microsoft_azure_app_service

  • Copy the raw URL of azuredeploy.json for XMSingle for Sitecore 9 from github.

https://raw.githubusercontent.com/Sitecore/Sitecore-Azure-Quickstart-Templates/master/Sitecore%209.0.0/XMSingle/azuredeploy.json

This was obtained from git after clicking on “raw” when the file is selected.

git raw

Its very important to get the “Raw” URL else you will keep getting template validation failed error on running PowerShell (PS) command.

  • Run PS as administrator.
  • Import Sitecore cloud cmdlets from Azure toolkit. This is required to run the cmd “Start-SitecoreAzureDeployment” that does the actual deployment. You will get “Start-SitecoreAzureDeployment” not recognized as a cmd error if this is not imported. Ran this cmd in Powershell to import:

Import-Module “D:\Sitecore Software\Sitecore9\Sitecore Azure Toolkit 2.0.0 rev.171010\tools\Sitecore.Cloud.Cmdlets.psm1”

  • Login to your Azure subscription. Ran cmd Add-AzureRMAccount. Failed with this error

AdAzureRM

This error will come if Azure Powershell is not installed and imported.

PS c:\> Get-Module PowerShellGet -list | Select-Object Name,Version,Path

GetModule

  • install the Azure PowerShell from the PowerShell Gallery by running following command:

PS C:\> Install-Module AzureRM

Command took 5-6 min to complete.

  • Then import the AzureRM module:

Import-Module AzureRMimportAzureRM

Azure Powershell is installed and imported.

  • Ran cmd Add-AzureRMAccount again.

Enter subscription details in the popup window.

  • Copy subscriptionId shown in PS and Run cmd

Set-AzureRMContext -SubscriptionId 62c6c7c3-cbda-4838-a3df-bfbf07ad72c4

AdAzureRM1

  • Now we need to prepare parameters required by cmd “Start-SitecoreAzureDeployment”
  • Edit the file “azuredeploy.parameters.json” downloaded from ARM templates from git for XMSingle topology of Sitecore 9.

https://github.com/Sitecore/Sitecore-Azure-Quickstart-Templates/blob/master/Sitecore%209.0.0/XMSingle/azuredeploy.parameters.json

I edited it to look like this

{

“$schema”: “https://schema.management.azure.com/schemas/2015-01-01/deploymentParameters.json#“,

“contentVersion”: “1.0.0.0”,

“parameters”: {

“deploymentId”: {

“value”: “ECMEntSolGrp”

},

“location”: {

“value”: “East US”

},

“sqlServerLogin”: {

“value”: “saCharu”

},

“sqlServerPassword”: {

“value”: “Password1!”

},

“singleMsDeployPackageUrl”: {

“value”: “https://ecmdatastore.blob.core.windows.net/sitecore/Sitecore%209.0.0%20rev.%20171002%20(Cloud)_single.scwdp.zip”

},

“sitecoreAdminPassword”: {

“value”: “Password1!”

},

“licenseXml”: {

“value”: “”

}

}

}

  • For  “singleMsDeployPackageUrl”, I uploaded the Sitecore package “Sitecore 9.0.0 rev. 171002 (Cloud)_single.scwdp.zip” ( Packages for XM Single downloaded  from “Download options for Azure AppService” for Sitecore 9 here https://dev.sitecore.net/Downloads/Sitecore_Experience_Platform/90/Sitecore_Experience_Platform_90_Initial_Release.aspx.) to Azure storage. Upload steps:
    • Login to portal.azure.com
    • Go to Storage Accounts.
    • Click on an existing account or create one.
    • Click on Blobs in the selected storage account.
    • Blob
    • Create a container or use an existing one.
    • Select the container and click Upload to upload the package.
    • Upload
    • Select the uploaded package
    • Uploaded
    • Copy the URL shown in Blob properties on the right side.
    • CopyBlobURL
  • Try the copied URL in browser. If it says Requested resource does not exist, you need to set the access policy of the container to allow anonymous read.
  • BlobAccess
  • alternative solution for live project is required based on Shared Access Signatures.
  • Start the deployment. Run cmds
    • $Parameters = @{ “deploymentId”=”ECMEntSolGrp”}

It succeeded. Took around 30 min to complete.

success

  • Logged in to portal.azure.com. Navigated to “App Services”. I can see a new WebApp “ecmentsolgrp-single” there.
  • AppService

Click this and click the URL of the site displayed on right.

SiteURL

The Sitecore site came up.

 Site  SiteLaunchPad

Few errors I had got before it finally worked:

  • “Start-SitecoreAzureDeployment is not recognized as a command”.  Had started the new PS session in between. So have to import module from Sitecore azure tool kit again.
  • Start-SitecoreAzureDeployment
  • error “Positional parameter could not be found.” There was a space between “-” and “SetKeyValue” in the command. Removed the space to resolve it.
  • Positional parameter
  • Error “Forbidden”. The -Name parameter of the command and “deploymentId” mentioned in $parameters and in azuredeploy.json should be the name of Resource Group (new or existing). I first used “XMSingle” for this but was getting “Forbidden” error. This was due to the fact that I did not have privilege to create a new Resource group (RG) in my Azure Subscription. So had to change it to existing RG name “ECMEntsolGrp”.
  • ResourceGroupName
  • “Errorcode Invalid template….Unexpected character encountered while parsing”. This was due to incorrect ArmTemplateUrl parameter. The URL needs to be the Raw URL of file azuredeploy.json from github as mentioned in concerned step above.
  • ArmTemplateUrl

Incorrect:  https://github.com/Sitecore/Sitecore-Azure-Quickstart-Templates/blob/master/Sitecore%209.0.0/XMSingle/azuredeploy.json

Correct: https://raw.githubusercontent.com/Sitecore/Sitecore-Azure-Quickstart-Templates/master/Sitecore%209.0.0/XMSingle/azuredeploy.json

  • “Lacation ‘East US 2’ is not available for Resource Type ‘Microsoft.Search/SearchServices'”. I had first specified location parameter as “East US 2” which is not available for Azure Search. Changed it to “East US” to resolve this error.
  • SearchServices
  •  “‘sa’ is not a valid login name in this version of SQL Server.” I had specified “sa” as value of “sqlServerLogin” in azuredeploy.parameters.json file. Changed it to “saCharu” to resolve.
  • Failed to download package.\r\nAppGallery Deploy Failed: ‘System.Net.WebException: The remote server returned an error: (404) Not Found.

As mentioned here  “singleMsDeployPackageUrl” the Sitecore package was not accessible due to Access Policy on the container in Azure Storage. Changed Access Policy on the container to allow anonymous read.

  • A self-signed certificate will be required for other topologies. I had created it for this as well as authCertificateBlob is mentioned in params here for XMSingle as well

https://doc.sitecore.net/sitecore_experience_platform/setting_up_and_maintaining/sitecore_on_azure/deploying/walkthrough_deploy_a_new_sitecore_environment_to_the_microsoft_azure_app_service but it was giving me error that “authCertificateBlob” is not present in original template and can not be supplied at deployment. So removed it. However, mentioning the steps here:

  • Created a self signed certificate: Open IIS, Click Server Certificates in IIS section, Click Create self signed certificate in right pane, Enter name and click Ok. Certificate will be visible in IIS. Right click created certificate and click Export. Specify file name and a password and click ok. “XMSingleCert.pfx” file got generated.
  • Entered this in azuredeploy.parameters.json in the end

“allowInvalidClientCertificates”: {

“value”: true

}

Remember to put ‘,’ after the end brace of last parameter else you will get the error while deploying.

The file looked like this at the end:

allowInvalidClientCertificates

  • To deploy, add this in $parameters

$Parameters = @{

“deploymentId”=”XMSingle”;

“authCertificateBlob” = [System.Convert]::ToBase64String([System.IO.File]::ReadAllBytes(“D:\Sitecore Software\Sitecore9\AzureDeplXMSingle\XMSingleCert.pfx”))