Logging

Logging allows libraries and apps to report potentially useful information about operations, and it allows apps and users to control how or if the logged information is displayed or collected. Logging information is primarily used to diagnose problems after the fact. Logging may also be used to monitor application health.

To log a message, call Logger.logError, Logger.logWarning, Logger.logInfo, or Logger.logTrace, depending on the level of importance of the message.

BentleyError is integrated with logging.

Logging messages will be tagged with an ActivityId to help you correlate frontend requests with backend operations.

LogLevels

Each of the logging output functions assigns a LogLevel to the specified message. LogLevel is like a property of a logging message. The app that produces logging messages can control output by filtering on LogLevel. And the dashboards that consume logging messages can filter and organize logging messages by LogLevels.

LogLevel is a pre-defined enum that is chosen by the app that generates logging messages. The app must choose the appropriate level for each message, so that the purpose of a message is clear and so that the most important messages stand out.

Categories

Each of the logging output functions takes the category of the message as its first argument and associates this string with the specified message. Category is like a property of a logging message. The app that produces logging messages can control output by filtering on category. And the dashboards that consume logging messages can filter and organize logging messages by categories.

Categories are freeform strings that are made up by the app that generates logging messages. A well-chosen category string make messages useful and manageable. In some cases, the category will be used to identify the source of the message. For example, when logging messages from many different services are streamed to a single file or dashboard, users will rely on the category of a message to identify its source. The category will also be used to group messages. For example, all logging messages that pertain to a certain module should have the same category.

Parent/child category naming is often useful for achieving uniqueness and grouping.

Parent and Child Categories

If a category name has a "." in it, then the part to the left is interpreted as the parent category and the part to the right is the child. If you pass a parent category to Logger.setLevel, then the specified level filter will be applied to all children of that level. If you call Logger.setLevel on a specific child category, then the level you specify will apply to that child, while the parent's level will apply to all other children. Children can be nested.

Controlling the Destination of Logging Messages

The app controls how to handle log messages by supplying to Logger.initialize the functions that handle messages for each log level. These functions are called "streams". See the convenience method Logger.initializeToConsole for a simple way to direct logging output to the console. BunyanLoggerConfig will direct logging to the Bunyan logging system. SeqLoggerConfig will direct logging to the seq logging server. FluentdBunyanLoggerConfig will direct loging to fluentd.

Controlling What is Logged

The app that produces logging output can apply filters at runtime to control which messages are actually sent to the destination.

The simplest way to turn off logging at a particular log level is for the app simply not to supply a stream for that level. Or, the app can supply a stream that does its own internal filtering.

Filtering messages by level and category

Logger.setLevel and Logger.configureLevels can be used to control logging output by level and category.

There are two filtering strategies.

1. Opt out.

In this strategy, you start by turning all categories on at a certain level by default and then setting the levels of specific categories to other levels.

Example:

Logger.initializeToConsole();
Logger.setLevelDefault(LogLevel.Error);
Logger.setLevel("Diagnostics", LogLevel.None);

This approach is mainly useful when you are just trying to find out what is happening. For example, to debug a problem when you do not know where to start looking, you might turn all categories "on" by default at some level. This can produce a lot of logging output. After reviewing the outpout, you might then turn "off" the categories that are not relevant to your search by setting their levels to None. You might also turn "up" the categories that seem to be of interest.

2. Opt in

In this strategy, you leave most categories off by default and then turn on the ones you do want.

Example:

Logger.initializeToConsole();
Logger.setLevel("MyCategory", LogLevel.Info);

This approach is useful when you want to monitor the activity in a small number of known modules, where you already know the names of the categories that they use.

Configuration Files

A service typically initializes and configures logging in its startup logic. Configuration can be based on the configuration parameters of the service, which may be set by the deployment mechanism. The simplest way to do this is to use LoggerLevelsConfig. This is normally used in conjunction with a stream config, for example, a SeqConfig. Both are normally stored in a config file that is deployed with the service. Finally, some specific configuration parameters are normally set at runtime, based on deployment parameters using EnvMacroSubst to do macro substitution.

Example:

import { Logger, LoggerLevelsConfig, EnvMacroSubst, BentleyError, IModelStatus } from "@bentley/bentleyjs-core";
import { BunyanLoggerConfig, SeqConfig, SeqLoggerConfig } from "@bentley/logger-config";

export function initializeLogging(): void {
  // Read the configuration parameters for my service. Some config
  // params might be specified as envvars.
  const config = require("./MyService.config.json");

  const defaultConfigValues: any = {
    "ROBOT-WORLD-DEFAULT-LOG-LEVEL": "Error",
    "ROBOT-WORLD-SEQ-URL": "http://localhost",
    "ROBOT-WORLD-SEQ-PORT": "5341",
  };

  EnvMacroSubst.replaceInProperties(config, true, defaultConfigValues);
  if (EnvMacroSubst.anyPropertyContainsEnvvars(config.seq, true)) {
    throw new BentleyError(IModelStatus.NotFound, "Unmatched environment variables in configuration.");
  }

  // Set up to log to the seq service
  if ("seq" in config) {
    SeqLoggerConfig.validateProps(config.seq);
    BunyanLoggerConfig.logToBunyan(SeqLoggerConfig.createBunyanSeqLogger(config.seq as SeqConfig, "RobotWorld"));
  }

  // Configure log levels by category
  if ("loggerConfig" in config) {
    Logger.validateProps(config.loggerConfig);
    Logger.configureLevels(config.loggerConfig as LoggerLevelsConfig);
  }
}

An example of the logging-related sections of a configuration .json file that is deployed with a service might be:

{
  "loggerConfig": {
     "defaultLevel": "${ROBOT-WORLD-DEFAULT-LOG-LEVEL}",
     "categoryLevels": [
         {"category": "ROBOT-WORLD", "logLevel": "Trace"},
         {"category": "imodeljs-rpc", "logLevel": "Trace"},
         {"category": "imodeljs-backend.AutoPush", "logLevel": "Trace"},
         {"category": "ECPresentation", "logLevel": "None"},
         {"category": "Diagnostics.ECSqlStatement", "logLevel": "None"},
         {"category": "ECObjectsNative", "logLevel": "None"},
         {"category": "UnitsNative", "logLevel": "None"},
         {"category": "BeSQLite", "logLevel": "None"}
     ]
   },
   "seq": {
     "hostURL": "${ROBOT-WORLD-SEQ-URL}",
     "port": "${ROBOT-WORLD-SEQ-PORT}"
   }
}

ActivityId and ClientRequestContext

An ActivityId is a globally unique Id that relates backend operations to frontend requests. The ClientRequestContext class manages the ActivityId for logging purposes. The current ActivityId is automatically associated as metadata with all logging messages.

Backend code must cooperate with iModel.js to manage the ClientRequestContext

Last Updated: 08 January, 2020