Release Notes 3.2

What’s New

Support for Apache Solr 9.11

This version supports Apache Solr 9.11.x. If you are migrating from Apache Solr 9.10.x, existing indexes and configurations of smart.finder can be reused.

Basic information on installing Apache Solr can be found at Required Software.

Information on configuring smart.finder in your Apache Solr instance can be found at Apache Solr Configuration.

Indexing OGC API Features

smart.finder can now index OGC API Features services. The configuration is similar to the indexing of ArcGIS Server layers. You can map the properties of a feature to fields of the Solr schema and create an indexing job for the URL of the items of a collection.

This feature is an initial base version with the following known limitations:

  • Only geometries in the coordinate reference system WGS 84 (longitude/latitude) are supported, according to CRS84 .

  • Nested JSON objects in the properties of an item are not indexed. Arrays are indexed as multiple values.

The documentation has been restructured for better clarity: The page Indexing Features describes the basic configuration. The specifics of the sources can be found at Indexing ArcGIS Server Layers and Indexing OGC API Features.

Support for constant values when indexing features

When indexing features, you can now also configure a constant value for fields that are not included in the properties of a feature. These values are then written to the index for all features. For more information, see Configuring Constant Values.

Update Notes

If you skip several versions during the update, please also follow all update notes of the intervening versions.

Migration Apache Solr 9.10.x to 9.11.x

After installing Apache Solr 9.11.x, the following steps are required to continue using existing smart.finder indexes and configurations. Reindexing is not required.

  1. Stop Apache Solr and back up the content of the $SOLR_HOME/lib directory.

  2. Delete the current content of $SOLR_HOME/lib. Copy the contents of [RELEASE-FOLDER]/resources/solr/cores/lib into the $SOLR_HOME/lib directory. Make sure that after copying, the permissions are set correctly so that the Solr process can access the files.

  3. The solrconfig.xml file in $SOLR_HOME/core0 must be updated. You can either use the file from [RELEASE-FOLDER]/resources/solr/cores/core0/conf/solrconfig.xml or selectively apply the change to your existing solrconfig.xml. To do so, remove the following section (/update/extract request handler) from your solrconfig.xml:

    <requestHandler name="/update/extract"
                    startup="lazy"
                    class="de.conterra.smartfinder.solr.handler.CustomExtractingRequestHandler">
        <lst name="defaults">
            <str name="lowernames">false</str>
            <str name="fmap.content">content</str>
            <str name="fmap.Content-Type">format</str>
            <str name="fmap.stream_name">identifier</str>
            <str name="uprefix">ignored_</str>
            <str name="update.chain">uuid</str>
            <str name="captureAttr">true</str>
        </lst>
        <str name="tika.config">tika-config.xml</str>
        <lst name="date.formats">
            <str>yyyy-MM-dd</str>
        </lst>
    </requestHandler>
  4. Apache Solr 9.11.x no longer needs to load the extraction module on startup. Change the SOLR_MODULES environment variable as follows:

    # Old, 9.10.x
    SOLR_MODULES=extraction,analysis-extras,scripting
    # New, 9.11.x
    SOLR_MODULES=analysis-extras,scripting

    The variable is typically defined in the file /etc/default/solr.in.sh (Linux) or [SOLR_INSTALL_DIR]/bin/solr.in.cmd (Windows, using set SOLR_MODULES=analysis-extras,scripting). For more information, see Apache Solr configuration.

  5. Start Apache Solr.

Indexing OGC API Features

With this version, you can index collections of OGC API Features services, see Indexing OGC API Features. Note the following points when you update.

New properties

The following properties are new. The default values are in the file WEB-INF/classes/default-application.properties. To change a value, add the property to the file [config.directory.location]/application.properties, see Configuration files.

Property Default value Description

indexing.ogc.items.limit

100

Number of items that smart.finder requests per request (parameter limit). You can override the value for each collection with the parameter limit in the file spring-ogc-features-config.xml.

indexing.ogc.items.maxRetryCount

5

Number of retries if a request fails.

indexing.ogc.items.retryDelayInSeconds

5

Delay in seconds between two retries.

indexing.ogc.items.default.title

no title

Title that smart.finder uses if there are no values for the configured title fields of an item.

Extended property indexing.config.endsWithResolver.suffixes

The property indexing.config.endsWithResolver.suffixes contains the new entry '/collections/*/items':'ogcApiFeaturesIndexingService'. With this entry, smart.finder selects the indexing service for OGC API Features for URLs that end with /collections/<ID>/items.

If you have overridden this property in the file application.properties, add the entry there. Otherwise, smart.finder does not select the indexing service for OGC API Features.

New configuration file spring-ogc-features-config.xml

The configuration of the OGC API Features indexing is located in the new file /smartfinder-search/WEB-INF/classes/spring-ogc-features-config.xml. The file is required and must contain the list ogcCollectionConfigurations. Without the file, smart.finder does not start. If you do not replace the files in the directory WEB-INF/classes completely during the update, copy the file from the delivery package to this directory.

The delivered file contains a sample configuration for the service "Geotope NRW". If you do not need it, remove the collections from the list.

New classes for configuring ArcGIS Server layers

The configuration classes in the package de.conterra.smartfinder.api.arcgis.arcgisserver are deprecated. Existing spring-feature-layer-config.xml files continue to work without changes. Switch the configuration to the new classes, see Deprecated configuration classes.

Replacement of the Vulnerability Report with a VEX file

The file vulnerability-report.md in the root directory of the unpacked rollout folder has been replaced by sbom/smartfinder-3.2.0-openvex.vex.json. VEX (Vulnerability Exploitability eXchange) is a machine-readable format that indicates whether a product is affected by known vulnerabilities.

Discontinued Features

  • Apache Solr 9.10.x is no longer supported.

Deprecated Features

  • The security.mode ONLY_AUTHN will be discontinued in one of the future versions.

  • The classes in the package de.conterra.smartfinder.api.arcgis.arcgisserver that you use to configure the indexing of ArcGIS Server layers in the file spring-feature-layer-config.xml are deprecated. Existing configurations continue to work. Use the following new classes instead. For more information, see Deprecated configuration classes.

    • de.conterra.smartfinder.api.arcgis.arcgisserver.LayerConfiguration → de.conterra.smartfinder.api.feature.arcgis.LayerConfiguration

    • de.conterra.smartfinder.api.arcgis.arcgisserver.FieldsIndexingConfig → de.conterra.smartfinder.api.feature.FieldsIndexingConfig

    • de.conterra.smartfinder.api.arcgis.arcgisserver.FieldToSchemaMapping → de.conterra.smartfinder.api.feature.FieldToSchemaMapping

    • de.conterra.smartfinder.api.arcgis.arcgisserver.TitleField → de.conterra.smartfinder.api.feature.TitleField

    • de.conterra.smartfinder.api.arcgis.arcgisserver.ConstantFieldValue → de.conterra.smartfinder.api.feature.ConstantFieldValue

Known Limitations

None.

Changelog

3.2.0

Fixed Security Issues

SNR-1231

[Security] Authorization bypass

New Features and Improvements

SNR-1250

[Indexing] Use Apache Tika internally

SNR-1247

[System] Upgrade to Apache Solr 9.11.0

SNR-1245

[Search] Fix/feature document store query options

SNR-1241

[Security] Original roles of a user can be retained as permissions

SNR-1240

[FeatureSearch] Improve handling of ArcGIS Server response

SNR-1239

[Proxy] Configure HTTP Version

SNR-1236

[FeatureSearch] Support for constant field values

SNR-1230

[Proxy] Return more specific HTTP status codes

SNR-1246

[Indexing] Handle non-array and unparsable WKT values when extracting item geometries

SNR-807

[FeatureSearch] Support for indexing OGC API Features collections

Fixed Issues

SNR-1237

[Search] searchUiService.reset() fails when smart.finder is integrated into the app

SNR-1195

[MultiCore] Using a Solr core other than “core0” causes a timeout

SNR-1098

[Search] Spatial filter changes slightly after going to detail page and back