1. Training
  2. Solr Training
  3. Advanced Solr
  4. New York – Fall 2016

Advanced Solr Training, New York – Fall 2016

Oct 12, 2016 (Wed) – 9:00 am to 5:00 pm

Completed

Overview

Rafal Kuć

Comprehensive 1-day Solr class taught by Rafal Kuć a seasoned Solr instructor and consultant from Sematext, and the author of several Solr and Elasticsearch books. In this course you will learn about query routing, results re-ranking, term vectors, schema API, custom similarity, merge policy, codecs, language identification, data import handler, advanced Solr and SolrCloud tuning and scaling, shard splitting, data migrations, handling a large number of collections, authentication, Solr and HDFS, and so on. See course outline below for more. Each section is followed by a lab with multiple hands-on exercises.

Who Should Attend

The course is designed for technical attendees experienced with Solr and looking to extending their Solr knowledge. A person should be able to index data to Solr, run queries, work with Solr analysis, use faceting, grouping, know basic Solr configuration and tuning principles. Experience with Linux systems is not a must, but a basic familiarity with running shell commands (e.g., using curl command) will make the course more enjoyable. If you do not have prior Solr experience and you would like to take advantage of Solr advance training, please consider attending Core Solr and Intermediate Solr classes.

Prerequisites

Sematext’s Intermediate Solr or pre-existing knowledge of Solr concepts covered in Intermediate and Core Solr

Things To Remember

  • Arrive at least 20 minutes early to class and on time after each break.
  • Participants must bring their own laptop with OSX, Linux or Windows to the workshop. Laptops should have the latest version of Java installed. You should be comfortable using a terminal / command line.

  • If you have any dietary restrictions be sure to let us know at least a week prior to the training.

What We Provide

For this training Sematext provides:
  • A digital copy of the training material
  • A VM with all configs, scripts, exercises, etc.
  • Breakfast, lunch, snacks, coffee, tea, juices, soft drinks, and water

Course Outline

Modules

  1. Search Under Control
    • Routing
    • Index time routing
    • Query time routing
    • Basic syntax for local params
    • Parameter dereferencing
    • Using parameter dereferencing in handlers configuration
    • Using filters tagging
    • Using faceting exclusions
    • Re-ranking queries results
    • Lab
      • Indexing documents with routing
      • Running queries with routing
      • Using parameter dereferencing to create your own parameters in query
      • Tagging and excluding filters
  2. Term Vectors
    • What are term vectors
    • Retrieving additional information from Solr
    • Understanding term vector component
    • Lab
      • Configure fields to use term vectors
      • Creating handlers that use term vectors
      • Retrieving term vectors when searching
      • Retrieving term positions and offsets
  3. Configuring Solr Index
    • Custom similarity
    • Schema API
    • Managed resources
    • Lab
      • Using Schema API to retrieve information about collection structure
      • Adding new field type using Schema API
      • Adding new field using Schema API
      • Adding copy field using Schema API
  4. Configuring Solr Internals
    • General solrconfig.xml sections
    • Lucene directory configuration
    • Schema factory settings
    • Codecs
    • Merge policy
    • Merge scheduler
    • Transaction log configuration
    • Replication
    • Update request processors
    • Language detection
    • Configuring logging
    • Slow query log
    • Lab
      • Configuring Solr to use managed schema
      • Preparing master – slave replication
      • Configuring slow logging
  5. Data Import Handler
    • Configuring data import handler
    • Using data import handler
    • Entity processors
    • Transformers
    • Lab
      • Importing data from SQL database
      • Partial data import from SQL database
      • Importing data from XML files using
  6. Streaming Aggregations
    • Streaming expressions basics
    • Stream sources
    • Stream decorators
    • Scheduling streams
    • SQL over MapReduce in SolrCloud
    • Export request handler
    • Lab
      • Searching using streaming aggregations
      • Merging two results streams
      • Retrieve unique documents based on a given field
      • Using scheduling streams
  7. Expert Tuning Solr
    • Memory considerations
    • Indexing threads
    • Auto commit tuning
    • Caches
    • Replication throttling
    • Lab
      • Configuring indexing threads
      • Configuring auto commits
      • Throttle replication
  8. Scaling Solr
    • Proper Solr master configuration
    • Proper Solr slaves configuration
    • Multiple masters architecture
    • Setting up Solr slaves for multiple masters
    • Indexing data in multi­master environment
    • Querying in multi­master environment
  9. Expert SolrCloud
    • ZooKeeper role explained
    • Sharding and replicating
    • Cluster state explained
    • Caches in SolrCloud
    • Shard splitting
    • Migrating data between collections
    • Working with large number of collections
    • Lab
      • Creating collection matching environment needs
      • Adding and removing replicas
      • Moving shards around the cluster
      • Adding shards to collection
      • Migrating data between collections
  10. Other Solr Features
    • Enabling security in SolrCloud
    • Basic authorization
    • Other authorization options
    • Running Solr on HDFS
    • Lab
      • Securing Solr instance
      • Giving permissions to users
      • Removing permissions from users