Apache SkyWalking – Events

Events: Release Apache SkyWalking Java Agent 8.14.0

Sun, 15 Jan 2023 00:00:00 +0000

SkyWalking Java Agent 8.14.0 is released. Go to downloads page to find release tars. Changes by Version

8.14.0

Polish test framework to support arm64/v8 platforms
Fix wrong config name plugin.toolkit.use_qualified_name_as_operation_name, and system variable name SW_PLUGIN_TOOLKIT_USE_QUALIFIED_NAME_AS_OPERATION_NAME:false. They were toolit.
Rename JDBI to JDBC
Support collecting dubbo thread pool metrics
Bump up byte-buddy to 1.12.19
Upgrade agent test tools
[Breaking Change] Compatible with 3.x and 4.x RabbitMQ Client, rename rabbitmq-5.x-plugin to rabbitmq-plugin
Polish JDBC plugins to make DBType accurate
Report the agent version to OAP as an instance attribute
Polish jedis-4.x-plugin to change command to lowercase, which is consistent with jedis-2.x-3.x-plugin
Add micronauthttpclient,micronauthttpserver,memcached,ehcache,guavacache,jedis,redisson plugin config properties to agent.config
Add Micrometer Observation support
Add tags mq.message.keys and mq.message.tags for RocketMQ producer span
Clean the trace context which injected into Pulsar MessageImpl after the instance recycled
Fix In the higher version of mysql-connector-java 8x, there is an error in the value of db.instance.
Add support for KafkaClients 3.x.
Support to customize the collect period of JVM relative metrics.
Upgrade netty-codec-http2 to 4.1.86.Final.
Put Agent-Version property reading in the premain stage to avoid deadlock when using jarsigner.
Add a config agent.enable(default: true) to support disabling the agent through system property -Dskywalking.agent.disable=false or system environment variable setting SW_AGENT_ENABLE=false.
Enhance redisson plugin to adopt uniform tags.

Documentation

Update Plugin-test.md, support string operators start with and end with
Polish agent configurations doc to fix type error

All issues and pull requests are here

Events: Release Apache SkyWalking Rust 0.5.0

Mon, 09 Jan 2023 00:00:00 +0000

SkyWalking Rust 0.5.0 is released. Go to downloads page to find release tars.

What’s Changed

Add management support. by @jmjoy in https://github.com/apache/skywalking-rust/pull/48
Add missing_docs lint and supply documents. by @jmjoy in https://github.com/apache/skywalking-rust/pull/49
Add authentication and custom intercept support. by @jmjoy in https://github.com/apache/skywalking-rust/pull/50
Bump to 0.5.0. by @jmjoy in https://github.com/apache/skywalking-rust/pull/51

Events: Release Apache SkyWalking Satellite 1.1.0

Fri, 06 Jan 2023 00:00:00 +0000

SkyWalking Satellite 1.1.0 is released. Go to downloads page to find release tars.

Features

Support transmit the OpenTelemetry Metrics protocol.
Upgrade to GO 1.18.
Add Docker images for arm64 architecture.
Support transmit Span Attached Event protocol data.
Support dotnet CLRMetric forward.

Bug Fixes

Fix the missing return data when receive metrics in batch mode.
Fix CVE-2022-21698, CVE-2022-27664.

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking Rover 0.4.0

Tue, 20 Dec 2022 00:00:00 +0000

SkyWalking Rover 0.4.0 is released. Go to downloads page to find release tars.

Features

Enhancing the render context for the Kubernetes process.
Simplify the logic of network protocol analysis.
Upgrade Go library to 1.18, eBPF library to 0.9.3.
Make the Profiling module compatible with more Linux systems.
Support monitor HTTP/1.x in the NETWORK profiling.

Bug Fixes

Documentation

Adding support version of Linux documentation.

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking for NodeJS 0.6.0

Mon, 05 Dec 2022 00:00:00 +0000

SkyWalking NodeJS 0.6.0 is released. Go to downloads page to find release tars.

Add missing build doc by @kezhenxu94 in https://github.com/apache/skywalking-nodejs/pull/92
Fix invalid url error in axios plugin by @kezhenxu94 in https://github.com/apache/skywalking-nodejs/pull/93
Ignore no requests if ignoreSuffix is empty by @michaelzangl in https://github.com/apache/skywalking-nodejs/pull/94
Escape HTTP method in regexp by @michaelzangl in https://github.com/apache/skywalking-nodejs/pull/95
docs: grammar improvements by @BFergerson in https://github.com/apache/skywalking-nodejs/pull/97
fix: entry span url in endponts using Express middleware/router objects by @BFergerson in https://github.com/apache/skywalking-nodejs/pull/96
chore: use openapi format for endpoint uris by @BFergerson in https://github.com/apache/skywalking-nodejs/pull/98
AWS DynamoDB, Lambda, SQS and SNS plugins, webpack by @tom-pytel in https://github.com/apache/skywalking-nodejs/pull/100
Fix nits by @wu-sheng in https://github.com/apache/skywalking-nodejs/pull/101
Update AxiosPlugin for v1.0+ by @tom-pytel in https://github.com/apache/skywalking-nodejs/pull/102

Events: Release Apache SkyWalking APM 9.3.0

Sat, 03 Dec 2022 00:00:00 +0000

SkyWalking 9.3.0 is released. Go to downloads page to find release tars.

Metrics Association

Dashboard	Pop-up Trace Query

APISIX Dashboard

Use Sharding MySQL as the Database

Virtual Cache Performance

Virtual MQ Performance

Project

Bump up the embedded swctl version in OAP Docker image.

OAP Server

Add component ID(133) for impala JDBC Java agent plugin and component ID(134) for impala server.
Use prepareStatement in H2SQLExecutor#getByIDs.(No function change).
Bump up snakeyaml to 1.32 for fixing CVE.
Fix DurationUtils.convertToTimeBucket missed verify date format.
Enhance LAL to support converting LogData to DatabaseSlowStatement.
[Breaking Change] Change the LAL script format(Add layer property).
Adapt ElasticSearch 8.1+, migrate from removed APIs to recommended APIs.
Support monitoring MySQL slow SQLs.
Support analyzing cache related spans to provide metrics and slow commands for cache services from client side
Optimize virtual database, fix dynamic config watcher NPE when default value is null
Remove physical index existing check and keep template existing check only to avoid meaningless retry wait in no-init mode.
Make sure instance list ordered in TTL processor to avoid TTL timer never runs.
Support monitoring PostgreSQL slow SQLs.
[Breaking Change] Support sharding MySQL database instances and tables by Shardingsphere-Proxy. SQL-Database requires removing tables log_tag/segment_tag/zipkin_query before OAP starts, if bump up from previous releases.
Fix meter functions avgHistogram, avgHistogramPercentile, avgLabeled, sumHistogram having data conflict when downsampling.
Do sorting readLabeledMetricsValues result forcedly in case the storage(database) doesn’t return data consistent with the parameter list.
Fix the wrong watch semantics in Kubernetes watchers, which causes heavy traffic to API server in some Kubernetes clusters, we should use Get State and Start at Most Recent semantic instead of Start at Exact because we don’t need the changing history events, see https://kubernetes.io/docs/reference/using-api/api-concepts/#semantics-for-watch.
Unify query services and DAOs codes time range condition to Duration.
[Breaking Change]: Remove prometheus-fetcher plugin, please use OpenTelemetry to scrape Prometheus metrics and set up SkyWalking OpenTelemetry receiver instead.

BugFix: histogram metrics sent to MAL should be treated as OpenTelemetry style, not Prometheus style:

(-infinity, explicit_bounds[i]] for i == 0
(explicit_bounds[i-1], explicit_bounds[i]] for 0 < i < size(explicit_bounds)
(explicit_bounds[i-1], +infinity) for i == size(explicit_bounds)

Support Golang runtime metrics analysis.
Add APISIX metrics monitoring
Support skywalking-client-js report empty service version and page path , set default version as latest and default page path as /(root). Fix the error fetching data (/browser_app_page_pv0) : Can't split endpoint id into 2 parts.
[Breaking Change] Limit the max length of trace/log/alarm tag’s key=value, set the max length of column tags in tableslog_tag/segment_tag/alarm_record_tag and column query in zipkin_query and column tag_value in tag_autocomplete to 256. SQL-Database requires altering these columns’ length or removing these tables before OAP starts, if bump up from previous releases.
Optimize the creation conditions of profiling task.
Lazy load the Kubernetes metadata and switch from event-driven to polling. Previously we set up watchers to watch the Kubernetes metadata changes, this is perfect when there are deployments changes and SkyWalking can react to the changes in real time. However when the cluster has many events (such as in large cluster or some special Kubernetes engine like OpenShift), the requests sent from SkyWalking becomes unpredictable, i.e. SkyWalking might send massive requests to Kubernetes API server, causing heavy load to the API server. This PR switches from the watcher mechanism to polling mechanism, SkyWalking polls the metadata in a specified interval, so that the requests sent to API server is predictable (~10 requests every interval, 3 minutes), and the requests count is constant regardless of the cluster’s changes. However with this change SkyWalking can’t react to the cluster changes in time, but the delay is acceptable in our case.
Optimize the query time of tasks in ProfileTaskCache.
Fix metrics was put into wrong slot of the window in the alerting kernel.
Support sumPerMinLabeled in MAL.
Bump up jackson databind, snakeyaml, grpc dependencies.
Support export Trace and Log through Kafka.
Add new config initialization mechanism of module provider. This is a ModuleManager lib kernel level change.
[Breaking Change] Support new records query protocol, rename the column named service_id to entity_id for support difference entity. Please re-create top_n_database_statement index/table.
Remove improper self-obs metrics in JvmMetricsHandler(for Kafka channel).
gRPC stream canceling code is not logged as an error when the client cancels the stream. The client cancels the stream when the pod is terminated.
[Breaking Change] Change the way of loading MAL rules(support pattern).
Move k8s relative MAL files into /otel-rules/k8s.
[Breaking Change] Refactor service mesh protobuf definitions and split TCP-related metrics to individual definition.
Add TCP{Service,ServiceInstance,ServiceRelation,ServiceInstanceRelation} sources and split TCP-related entities out from original Service,ServiceInstance,ServiceRelation,ServiceInstanceRelation.
[Breaking Change] TCP-related source names are changed, fields of TCP-related sources are changed, please refer to the latest oal/tcp.oal file.
Do not log error logs when failed to create ElasticSearch index because the index is created already.
Add virtual MQ analysis for native traces.
Support Python runtime metrics analysis.
Support sampledTrace in LAL.
Support multiple rules with different names under the same layer of LAL script.
(Optimization) Reduce the buffer size(queue) of MAL(only) metric streams. Set L1 queue size as 1/20, L2 queue size as 1/2.
Support monitoring MySQL/PostgreSQL in the cluster mode.
[Breaking Change] Migrate to BanyanDB v0.2.0.
- Adopt new OR logical operator for,
  1. MeasureIDs query
  2. BanyanDBProfileThreadSnapshotQueryDAO query
  3. Multiple Event conditions query
  4. Metrics query
- Simplify Group check and creation
- Partially apply UITemplate changes
- Support index_only
- Return CompletableFuture<Void> directly from BanyanDB client
- Optimize data binary parse methods in *LogQueryDAO
- Support different indexType
- Support configuration for TTL and (block|segment) intervals
Elasticsearch storage: Provide system environment variable(SW_STORAGE_ES_SPECIFIC_INDEX_SETTINGS) and support specify the settings (number_of_shards/number_of_replicas) for each index individually.
Elasticsearch storage: Support update index settings (number_of_shards/number_of_replicas) for the index template after rebooting.
Optimize MQ Topology analysis. Use entry span’s peer from the consumer side as source service when no producer instrumentation(no cross-process reference).
Refactor JDBC storage implementations to reuse logics.
Fix ClassCastException in LoggingConfigWatcher.
Support span attached event concept in Zipkin and SkyWalking trace query.
Support span attached events on Zipkin lens UI.
Force UTF-8 encoding in JsonLogHandler of kafka-fetcher-plugin.
Fix max length to 512 of entity, instance and endpoint IDs in trace, log, profiling, topN tables(JDBC storages). The value was 200 by default.
Add component IDs(135, 136, 137) for EventMesh server and client-side plugins.
Bump up Kafka client to 2.8.1 to fix CVE-2021-38153.
Remove lengthEnvVariable for Column as it never works as expected.
Add LongText to support longer logs persistent as a text type in ElasticSearch, instead of a keyword, to avoid length limitation.
Fix wrong system variable name SW_CORE_ENABLE_ENDPOINT_NAME_GROUPING_BY_OPENAPI. It was opaenapi.
Fix not-time-series model blocking OAP boots in no-init mode.
Fix ShardingTopologyQueryDAO.loadServiceRelationsDetectedAtServerSide invoke backend miss parameter serviceIds.
Changed system variable SW_SUPERDATASET_STORAGE_DAY_STEP to SW_STORAGE_ES_SUPER_DATASET_DAY_STEP to be consistent with other ES storage related variables.
Fix ESEventQueryDAO missing metric_table boolQuery criteria.
Add default entity name(_blank) if absent to avoid NPE in the decoding. This caused Can't split xxx id into 2 parts.
Support dynamic config the sampling strategy in network profiling.
Zipkin module support BanyanDB storage.
Zipkin traces query API, sort the result set by start time by default.
Enhance the cache mechanism in the metric persistent process.
- This cache only worked when the metric is accessible(readable) from the database. Once the insert execution is delayed due to the scale, the cache loses efficacy. It only works for the last time update per minute, considering our 25s period.
- Fix ID conflicts for all JDBC storage implementations. Due to the insert delay, the JDBC storage implementation would still generate another new insert statement.
[Breaking Change] Remove core/default/enableDatabaseSession config.
[Breaking Change] Add @BanyanDB.TimestampColumn to identify which column in Record is providing the timestamp(milliseconds) for BanyanDB, since BanyanDB stream requires a timestamp in milliseconds. For SQL-Database: add new column timestamp for tables profile_task_log/top_n_database_statement, requires altering this column or removing these tables before OAP starts, if bump up from previous releases.
Fix Elasticsearch storage: In No-Sharding Mode, add specific analyzer to the template before index creation to avoid update index error.
Internal API: remove undocumented ElasticSearch API usage and use documented one.
Fix BanyanDB.ShardingKey annotation missed in the generated OAL metrics classes.
Fix Elasticsearch storage: Query sortMetrics missing transform real index column name.
Rename BanyanDB.ShardingKey to BanyanDB.SeriesID.
Self-Observability: Add counters for metrics reading from DB or cached. Dashboard:Metrics Persistent Cache Count.
Self-Observability: Fix GC Time calculation.
Fix Elasticsearch storage: In No-Sharding Mode, column’s property indexOnly not applied and cannot be updated.
Update the trace_id field as storage only(cannot be queried) in top_n_database_statement, top_n_cache_read_command, top_n_cache_read_command index.

UI

Fix: tab active incorrectly, when click tab space
Add impala icon for impala JDBC Java agent plugin.
(Webapp)Bump up snakeyaml to 1.31 for fixing CVE-2022-25857
[Breaking Change]: migrate from Spring Web to Armeria, now you should use the environment variable name SW_OAP_ADDRESS to change the OAP backend service addresses, like SW_OAP_ADDRESS=localhost:12800,localhost:12801, and use environment variable SW_SERVER_PORT to change the port. Other Spring-related configurations don’t take effect anymore.
Polish the endpoint list graph.
Fix styles for an adaptive height.
Fix setting up a new time range after clicking the refresh button.
Enhance the process topology graph to support dragging nodes.
UI-template: Fix metrics calculation in general-service/mesh-service/faas-function top-list dashboard.
Update MySQL dashboard to visualize collected slow SQLs.
Add virtual cache dashboard.
Remove responseCode fields of all OAL sources, as well as examples to avoid user’s confusion.
Remove All from the endpoints selector.
Enhance menu configurations to make it easier to change.
Update PostgreSQL dashboard to visualize collected slow SQLs.
Add Golang runtime metrics and cpu/memory used rate panels in General-Instance dashboard.
Add gateway apisix menu.
Query logs with the specific service ID.
Bump d3-color from 3.0.1 to 3.1.0.
Add Golang runtime metrics and cpu/memory used rate panels in FaaS-Instance dashboard.
Revert logs on trace widget.
Add a sub-menu for virtual mq.
Add readRecords to metric types.
Verify dashboard names for new dashboards.
Associate metrics with the trace widget on dashboards.
Fix configuration panel styles.
Remove a un-use icon.
Support labeled value on the service/instance/endpoint list widgets.
Add menu for virtual MQ.
Set selector props and update configuration panel styles.
Add Python runtime metrics and cpu/memory utilization panels to General-Instance and Fass-Instance dashboards.
Enhance the legend of metrics graph widget with the summary table.
Add apache eventMesh logo file.
Fix conditions for trace profiling.
Fix tag keys list and duration condition.
Fix typo.
Fix condition logic for trace tree data.
Enhance tags component to search tags with the input value.
Fix topology loading style.
Fix update metric processor for the readRecords and remove readSampledRecords from metrics selector.
Add trace association for FAAS dashboards.
Visualize attached events on the trace widget.
Add HTTP/1.x metrics and HTTP req/resp body collecting tabs on the network profiling widget.
Implement creating tasks ui for network profiling widget.
Fix entity types for ProcessRelation.
Add trace association for general service dashboards.

Documentation

Add metadata-uid setup doc about Kubernetes coordinator in the cluster management.
Add a doc for adding menus to booster UI.
Move general good read blogs from Agent Introduction to Academy.
Add re-post for blog Scaling with Apache SkyWalking in the academy list.
Add re-post for blog Diagnose Service Mesh Network Performance with eBPF in the academy list.
Add Security Notice doc.
Add new docs for Report Span Attached Events data collecting protocol.
Add new docs for Record query protocol
Update Server Agents and Compatibility for PHP agent.
Add docs for profiling.
Update the network profiling documentation.

All issues and pull requests are here

Events: Release Apache SkyWalking Kubernetes Helm Chart 4.4.0

Tue, 29 Nov 2022 00:00:00 +0000

SkyWalking Kubernetes Helm Chart 4.4.0 is released. Go to downloads page to find release tars.

[Breaking Change]: remove .Values.oap.initEs, there is no need to use this to control whether to run init job anymore, SkyWalking Helm Chart automatically delete the init job when installing/upgrading.
[Breaking Change]: remove files/config.d mechanism and use values.yaml files to put the configurations to override default config files in the /skywalking/config folder, using files/config.d is very limited and you have to clone the source codes if you want to use this mechanism, now you can simply use our Docker Helm Chart to install.
Refactor oap init job, and support postgresql storage.
Upgrade ElasticSearch Helm Chart dependency version.

Events: Release Apache SkyWalking PHP 0.2.0

Mon, 28 Nov 2022 00:00:00 +0000

SkyWalking PHP 0.2.0 is released. Go to downloads page to find release tars.

What’s Changed

Update PECL user by @heyanlong in https://github.com/apache/skywalking-php/pull/12
Start up 0.2.0 by @heyanlong in https://github.com/apache/skywalking-php/pull/13
Update compiling project document. by @jmjoy in https://github.com/apache/skywalking-php/pull/14
Add PDO plugin, and switch unix datagram to stream. by @jmjoy in https://github.com/apache/skywalking-php/pull/15
Update readme about creating issue. by @jmjoy in https://github.com/apache/skywalking-php/pull/17
Fix package.xml role error by @heyanlong in https://github.com/apache/skywalking-php/pull/16
Add swoole support. by @jmjoy in https://github.com/apache/skywalking-php/pull/19
Add .fleet to .gitignore by @heyanlong in https://github.com/apache/skywalking-php/pull/20
[Feature] Add Mysql Improved Extension by @heyanlong in https://github.com/apache/skywalking-php/pull/18
Add predis plugin. by @jmjoy in https://github.com/apache/skywalking-php/pull/21
Take care of PDO false and DSN tailing semicolons. by @phanalpha in https://github.com/apache/skywalking-php/pull/22
Add container by @heyanlong in https://github.com/apache/skywalking-php/pull/23
Save PDO exceptions. by @phanalpha in https://github.com/apache/skywalking-php/pull/24
Update minimal supported PHP version to 7.2. by @jmjoy in https://github.com/apache/skywalking-php/pull/25
Utilize UnixListener for the worker process to accept reports. by @phanalpha in https://github.com/apache/skywalking-php/pull/26
Kill the worker on module shutdown. by @phanalpha in https://github.com/apache/skywalking-php/pull/28
Add plugin for memcached. by @jmjoy in https://github.com/apache/skywalking-php/pull/27
Upgrade rust mini version to 1.65. by @jmjoy in https://github.com/apache/skywalking-php/pull/30
Add plugin for phpredis. by @jmjoy in https://github.com/apache/skywalking-php/pull/29
Add missing request_id. by @jmjoy in https://github.com/apache/skywalking-php/pull/31
Adapt virtual cache. by @jmjoy in https://github.com/apache/skywalking-php/pull/32
Fix permission denied of unix socket. by @jmjoy in https://github.com/apache/skywalking-php/pull/33
Bump to 0.2.0. by @jmjoy in https://github.com/apache/skywalking-php/pull/34

New Contributors

@phanalpha made their first contribution in https://github.com/apache/skywalking-php/pull/22

Full Changelog: https://github.com/apache/skywalking-php/compare/v0.1.0...v0.2.0

PECL

https://pecl.php.net/package/skywalking_agent/0.2.0

Events: SkyWalking v8 OAP server End-of-life(EOL)

Sun, 20 Nov 2022 00:00:00 +0000

This is an official annoucement from SkyWalking team.

Due to the Plan to End-of-life(EOL) all v8 releases in Nov. 2022 had been posted in 3 months, SkyWalking community doesn’t received any objection or a proposal about releasing a new patch version.

Now, it is time to end the v8 series. All documents of v8 are not going to be hosted on the website. You only could find the artifacts and source codes from the Apache’s archive repository. The documents of each version are included in /docs/ folder in the source tars.

The SkyWalking community would reject the bug reports and release proposal due to its End-of-life(EOL) status. v9 provides more powerful features and covers all capabilities of the latest v8. Recommend upgrading to the latest.

V8 was a memorable and significative release series, which makes the project globally adopted. It brought dev community scale up to over 500 contributors.

We want to highlight and thank all those contributors and end users again. You made today’s SkyWalking.

Welcome more contributors and users to join the community, to contribute your ideas, experiences, and feedback. We need you to improve and enhance the project to a higher level.

Events: Release Apache SkyWalking BanyanDB 0.2.0

Wed, 09 Nov 2022 00:00:00 +0000

SkyWalking BanyanDB 0.2.0 is released. Go to downloads page to find release tars.

Features

Command line tool: bydbctl.
Retention controller.
Full-text searching.
TopN aggregation.
Add RESTFul style APIs based on gRPC gateway.
Add “exists” endpoints to the schema registry.
Support tag-based CRUD of the property.
Support index-only tags.
Support logical operator(and & or) for the query.

Bugs

“metadata” syncing pipeline complains about an “unknown group”.
“having” semantic inconsistency.
“tsdb” leaked goroutines.

Chores

“tsdb” structure optimization.
- Merge the primary index into the LSM-based index
- Remove term metadata.
Memory parameters optimization.
Bump go to 1.19.

Events: Release Apache SkyWalking Java Agent 8.13.0

Wed, 09 Nov 2022 00:00:00 +0000

SkyWalking Java Agent 8.13.0 is released. Go to downloads page to find release tars. Changes by Version

8.13.0

This release begins to adopt SkyWalking 9.3.0+ Virtual Cache Analysis,Virtual MQ Analysis

Support set-type in the agent or plugin configurations
Optimize ConfigInitializer to output warning messages when the config value is truncated.
Fix the default value of the Map field would merge rather than override by new values in the config.
Support to set the value of Map/List field to an empty map/list.
Add plugin to support Impala JDBC 2.6.x.
Update guava-cache, jedis, memcached, ehcache plugins to adopt uniform tags.
Fix Apache ShenYu plugin traceId empty string value.
Add plugin to support brpc-java-3.x
Update compose-start-script.template to make compatible with new version docker compose
Bump up grpc to 1.50.0 to fix CVE-2022-3171
Polish up nats plugin to unify MQ related tags
Correct the duration of the transaction span for Neo4J 4.x.
Plugin-test configuration.yml dependencies support docker service command field
Polish up rabbitmq-5.x plugin to fix missing broker tag on consumer side
Polish up activemq plugin to fix missing broker tag on consumer side
Enhance MQ plugin relative tests to check key tags not blank.
Add RocketMQ test scenarios for version 4.3 - 4.9. No 4.0 - 4.2 release images for testing.
Support mannual propagation of tracing context to next operators for webflux.
Add MQ_TOPIC and MQ_BROKER tags for RocketMQ consumer’s span.
Polish up Pulsar plugins to remove unnecessary dynamic value , set peer at consumer side
Polish Kafka plugin to set peer at the consumer side.
Polish NATS plugin to set peer at the consumer side.
Polish ActiveMQ plugin to set peer at the consumer side.
Polish RabbitMQ plugin to set peer at the consumer side.

Documentation

Update configuration doc about overriding default value as empty map/list accordingly.
Update plugin dev tags for cache relative tags.
Add plugin dev docs for virtual database tags.
Add plugin dev docs for virtual MQ tags.
Add doc about kafka plugin Manual APIs.

All issues and pull requests are here

Events: Release Apache SkyWalking Client JS 0.9.0

Thu, 13 Oct 2022 00:00:00 +0000

SkyWalking Client JS 0.9.0 is released. Go to downloads page to find release tars.

Fix custom configurations when the page router changed for SPA.
Fix reporting data by navigator.sendbeacon when pages is closed.
Bump dependencies.
Add Security Notice.
Support adding custom tags to spans.
Validate custom parameters for register.

Events: Welcome Yueqin Zhang as a new committer

Sun, 09 Oct 2022 00:00:00 +0000

I am excited to announce a new SkyWalking committer, Yueqin Zhang(GitHub ID, yswdqz). Yueqin entered the SkyWalking community on Jul. 3rd[1], 2022, for the first time. Later, I knew he was invited by Yihao Chen, our committer, who is running an open-source program for students who can’t join Summer 2022 due to SkyWalking having limited slots.

His first PR[2] for Issue #7420 took 20 days to propose. I believe he took incredibly hard work in his own time. For every PMC member, we all were there. Purely following documents and existing codes to build a new feature is always not easy to start.

After that, we had several private talks, he asked for more possible directions to join the community deeper. Then, I am honored to witness a great landscape extension in SkyWalking feature territory, SkyWalking adopts OpenTelemetry features quickly, and is powered by our powerful MAL and v9 kernel/UI, He built MySQL and PostgreSQL server monitoring, metrics, and slow SQLs collecting(through enhancing LAL with a new layer concept), under a new menu, .

It is unbelievable to see his contributions in the main repo, 8 PRs[3], LOC 4,857++, 1,627–

Meanwhile, this story continues, he is trying to build A lightweight and APM-oriented SQL parser module[4] under my mentoring. This would be another challenging idea, but also very useful to enhance existing virtual database perf. analyzing.

I believe this would not be the end for the moment between SkyWalking and him.

Welcome to join the team.

Referrer & PMC member, Sheng Wu.

Events: Release Apache SkyWalking PHP 0.1.0

Sat, 08 Oct 2022 00:00:00 +0000

SkyWalking PHP 0.1.0 is released. Go to downloads page to find release tars.

What's Changed

[docs] Update README by @heyanlong in https://github.com/apache/skywalking-php/pull/1
Remove the CI limit first, in order to run CI. by @jmjoy in https://github.com/apache/skywalking-php/pull/3
Setup CI. by @jmjoy in https://github.com/apache/skywalking-php/pull/5
Implementation, with curl support. By @jmjoy in https://github.com/apache/skywalking-php/pull/4
Turn off Swoole support, and fix Makefile. By @jmjoy in https://github.com/apache/skywalking-php/pull/6
Update docs by @heyanlong in https://github.com/apache/skywalking-php/pull/7
Add PECL support. By @jmjoy in https://github.com/apache/skywalking-php/pull/8
Support macOS by replace ipc-channel with socket pair, upgrade dependencies and improve CI. by @jmjoy in https://github.com/apache/skywalking-php/pull/9
Add compile and release docs. By @jmjoy in https://github.com/apache/skywalking-php/pull/10
Update official documentation link. By @jmjoy in https://github.com/apache/skywalking-php/pull/11

New Contributors

@heyanlong made their first contribution in https://github.com/apache/skywalking-php/pull/1
@jmjoy made their first contribution in https://github.com/apache/skywalking-php/pull/3

Full Changelog: https://github.com/apache/skywalking-php/commits/v0.1.0

PECL

https://pecl.php.net/package/skywalking_agent/0.1.0

Events: Welcome Yanlong He and Jiemin Xia to join the PMC

Tue, 04 Oct 2022 00:00:00 +0000

Yanlong He (GitHub: heyanlong) is a SkyWalking committer for years. He was working on skyapm-php for years to support the SkyWalking ecosystem. That PHP agent has significant contributions for SkyWalking’s users adoption in the PHP landscape. Yanlong keeps active in supporting and maintaining the project to help the community.

Jiemin Xia (GitHub: jmjoy) is a new committer voted in July 2022. He is super active in this year. He took over the maintaince capatbilify from Rei Shimizu, who is too busy in his daily work. He leads on the Rust SDK, and is also a release manager for the Rust SDK.

Recently, both of them are working with Yanlong He to build a new skywalking PHP agent.

We are having our PHP agent v0.1.0 for the community.

SkyWalking PHP Agent

Notice, SkyAPM PHP is going to be archived and replaced by SkyWalking PHP agent according to its project maintainer, Yanlong He. Our community would work more closely forward the new PHP agent together.

Let’s welcome and congrats to our 31st and 32nd PMC members, Yanlong He and Jiemin Xia. We are honored to have you.

Events: Release Apache SkyWalking CLI 0.11.0

Tue, 20 Sep 2022 00:00:00 +0000

SkyWalking CLI 0.11.0 is released. Go to downloads page to find release tars.

Add .github/scripts to release source tarball by @kezhenxu94 in https://github.com/apache/skywalking-cli/pull/140
Let the eBPF profiling could performs by service level by @mrproliu in https://github.com/apache/skywalking-cli/pull/141
Add the sub-command for estimate the process scale by @mrproliu in https://github.com/apache/skywalking-cli/pull/142
feature: update install.sh version regex by @Alexxxing in https://github.com/apache/skywalking-cli/pull/143
Update the commands relate to the process by @mrproliu in https://github.com/apache/skywalking-cli/pull/144
Add layer to event related commands by @fgksgf in https://github.com/apache/skywalking-cli/pull/145
Add layer to events.graphql by @fgksgf in https://github.com/apache/skywalking-cli/pull/146
Add layer field to alarms.graphql by @fgksgf in https://github.com/apache/skywalking-cli/pull/147
Upgrade crypto lib to fix cve by @kezhenxu94 in https://github.com/apache/skywalking-cli/pull/148
Remove layer field in the instance and process commands by @mrproliu in https://github.com/apache/skywalking-cli/pull/149
Remove duration flag in profiling ebpf schedules by @mrproliu in https://github.com/apache/skywalking-cli/pull/150
Remove total field in trace list and logs list commands by @mrproliu in https://github.com/apache/skywalking-cli/pull/152
Remove total field in event list, browser logs, alarm list commands. by @mrproliu in https://github.com/apache/skywalking-cli/pull/153
Add aggregate flag in profiling ebpf analysis commands by @mrproliu in https://github.com/apache/skywalking-cli/pull/154
event: fix event query should query all types by default by @kezhenxu94 in https://github.com/apache/skywalking-cli/pull/155
Fix a possible lint error and update CI lint version by @JarvisG495 in https://github.com/apache/skywalking-cli/pull/156
Add commands for support network profiling by @mrproliu in https://github.com/apache/skywalking-cli/pull/158
Add the components field in the process relation by @mrproliu in https://github.com/apache/skywalking-cli/pull/159
Trim license headers in query string by @kezhenxu94 in https://github.com/apache/skywalking-cli/pull/160
Bump up dependency swck version to fix CVE by @kezhenxu94 in https://github.com/apache/skywalking-cli/pull/161
Bump up swck dependency for transitive dep upgrade by @kezhenxu94 in https://github.com/apache/skywalking-cli/pull/162
Add the sub-commands for query sorted metrics/records by @mrproliu in https://github.com/apache/skywalking-cli/pull/163
Add compatibility documentation by @mrproliu in https://github.com/apache/skywalking-cli/pull/164
Overhaul licenses, prepare for 0.11.0 by @kezhenxu94 in https://github.com/apache/skywalking-cli/pull/165

Events: Release Apache SkyWalking Kubernetes Helm Chart 4.3.0

Tue, 20 Sep 2022 00:00:00 +0000

SkyWalking Kubernetes Helm Chart 4.3.0 is released. Go to downloads page to find release tars.

Fix hasSuffix replace hasPrefix by @geffzhang in https://github.com/apache/skywalking-kubernetes/pull/86
Add “pods/log” permission to OAP so on-demand Pod log can work by @kezhenxu94 in https://github.com/apache/skywalking-kubernetes/pull/87
add .Values.oap.initEs to work with ES initial by @williamyao1982 in https://github.com/apache/skywalking-kubernetes/pull/88
Remove Istio adapter, add changelog for 4.3.0 by @kezhenxu94 in https://github.com/apache/skywalking-kubernetes/pull/89
Bump up helm chart version by @kezhenxu94 in https://github.com/apache/skywalking-kubernetes/pull/90

Events: Release Apache SkyWalking Cloud on Kubernetes 0.7.0

Fri, 16 Sep 2022 00:00:00 +0000

SkyWalking Cloud on Kubernetes 0.7.0 is released. Go to downloads page to find release tars.

Features

Replace go-bindata with embed lib.
Add the OAPServerConfig CRD, webhooks and controller.
Add the OAPServerDynamicConfig CRD, webhooks and controller.
Add the SwAgent CRD, webhooks and controller.
[Breaking Change] Remove the way to configure the agent through Configmap.

Bugs

Fix the error in e2e testing.
Fix status inconsistent with CI.
Bump up prometheus client version to fix cve.

Chores

Bump several dependencies of adapter.
Update license eye version.
Bump up SkyWalking OAP to 9.0.0.
Bump up the k8s api of the e2e environment to v1.21.10.

Events: Release Apache SkyWalking Rover 0.3.0

Mon, 12 Sep 2022 00:00:00 +0000

SkyWalking Rover 0.3.0 is released. Go to downloads page to find release tars.

Features

Support NETWORK Profiling.
Let the logger as a configurable module.
Support analyze the data of OpenSSL, BoringSSL library, GoTLS, NodeTLS in NETWORK Profiling.
Enhancing the kubernetes process finder.

Bug Fixes

Fixed reading process paths incorrect when running as a container.
Fix the crash caused by multiple profiling tasks.

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking Java Agent 8.12.0

Sat, 03 Sep 2022 00:00:00 +0000

SkyWalking Java Agent 8.12.0 is released. Go to downloads page to find release tars. Changes by Version

8.12.0

Fix Shenyu plugin's NPE in reading trace ID when IgnoredTracerContext is used in the context.
Update witness class in elasticsearch-6.x-plugin, avoid throw NPE.
Fix onHalfClose using span operation name /Request/onComplete instead of the wrong name /Request/onHalfClose.
Add plugin to support RESTeasy 4.x.
Add plugin to support hutool-http 5.x.
Add plugin to support Tomcat 10.x.
Save http status code regardless of it’s status.
Upgrade byte-buddy to 1.12.13, and adopt byte-buddy APIs changes.
Upgrade gson to 2.8.9.
Upgrade netty-codec-http2 to 4.1.79.Final.
Fix race condition causing agent to not reconnect after network error
Force the injected high-priority classes in order to avoid NoClassDefFoundError.
Plugin to support xxl-job 2.3.x.
Add plugin to support Micronaut(HTTP Client/Server) 3.2.x-3.6.x
Add plugin to support NATS Java client 2.14.x-2.15.x
Remove inappropriate dependency from elasticsearch-7.x-plugin
Upgrade jedis plugin to support 3.x(stream),4.x

Documentation

Add a section in Bootstrap-plugins doc, introducing HttpURLConnection Plugin compatibility.
Update Plugin automatic test framework, fix inconsistent description about configuration.yml.
Update Plugin automatic test framework, add expected data format of the log items.

All issues and pull requests are here

Events: Plan to End-of-life(EOL) all v8 releases in Nov. 2022

Fri, 02 Sep 2022 00:00:00 +0000

This is an official annoucement from SkyWalking team.

SkyWalking backend server and UI released significant 9.2.0 at Sep. 2nd, 2022. With the new added Layer concept, the ebpf agent, wider middleware server monitoring(Such as MySQL and PostgreSQL servers) powered by OpenTelemetry ecosystem, SkyWalking v9 has been much more powerful than the last v8 version(8.9.1).

From now, we have resolved all found critical bugs since 9.0.0 release which could block the v8 users to upgrade. v9 releases also provide the as same compatibility as the 8.9.1 release. So, end users would not have a block when they apply to upgrade. (We don’t provide storage structure compatibility as usually, users should use an empty database to initialize for a new version.)

And more importantly, we are confident that, v9 could provide a stable and higher performance APM in the product environment.

The 8.9.1 release was released at Dec., 2021. Since then, there is no one contributed any code, and there is no committer requested to begin a new iteration or plan to run a patch release. From the project management committee perspective, the 8.x had became inactive.

We are going to wait for another 3 month to official end 8.x series’ life.

Notice, this could be changed if there are at least 3 committers supporting to work on further 8.x releases officially, and provide a release plan.

Events: Release Apache SkyWalking APM 9.2.0

Thu, 01 Sep 2022 00:00:00 +0000

SkyWalking 9.2.0 is released. Go to downloads page to find release tars.

eBPF Network Profiling for K8s Pod

Event and Metrics Association

MySQL Server Monitoring

PostgreSQL Server Monitoring

Project

[Critical] Fix a low performance issue of metrics persistent in the ElasticSearch storage implementation. One single metric could have to wait for an unnecessary 7~10s(System Env Variable SW_STORAGE_ES_FLUSH_INTERVAL) since 8.8.0 - 9.1.0 releases.
Upgrade Armeria to 1.16.0, Kubernetes Java client to 15.0.1.

OAP Server

Add more entities for Zipkin to improve performance.
ElasticSearch: scroll id should be updated when scrolling as it may change.
Mesh: fix only last rule works when multiple rules are defined in metadata-service-mapping.yaml.
Support sending alarm messages to PagerDuty.
Support Zipkin kafka collector.
Add VIRTUAL detect type to Process for Network Profiling.
Add component ID(128) for Java Hutool plugin.
Add Zipkin query exception handler, response error message for illegal arguments.
Fix a NullPointerException in the endpoint analysis, which would cause missing MQ-related LocalSpan in the trace.
Add forEach, processRelation function to MAL expression.
Add expPrefix, initExp in MAL config.
Add component ID(7015) for Python Bottle plugin.
Remove legacy OAL percentile functions, p99, p95, p90, p75, p50 func(s).
Revert #8066. Keep all metrics persistent even it is default value.
Skip loading UI templates if folder is empty or doesn’t exist.
Optimize ElasticSearch query performance by using _mGet and physical index name rather than alias in these scenarios, (a) Metrics aggregation (b) Zipkin query (c) Metrics query (d) Log query
Support the NETWORK type of eBPF Profiling task.
Support sumHistogram in MAL.
[Breaking Change] Make the eBPF Profiling task support to the service instance level, index/table ebpf_profiling_task is required to be re-created when bump up from previous releases.
Fix race condition in Banyandb storage
Support SUM_PER_MIN downsampling in MAL.
Support sumHistogramPercentile in MAL.
Add VIRTUAL_CACHE to Layer, to fix conjectured Redis server, which icon can’t show on the topology.
[Breaking Change] Elasticsearch storage merge all metrics/meter and records(without super datasets) indices into one physical index template metrics-all and records-all on the default setting. Provide system environment variable(SW_STORAGE_ES_LOGIC_SHARDING) to shard metrics/meter indices into multi-physical indices as the previous versions(one index template per metric/meter aggregation function). In the current one index mode, users still could choose to adjust ElasticSearch’s shard number(SW_STORAGE_ES_INDEX_SHARDS_NUMBER) to scale out. More details please refer to New ElasticSearch storage option explanation in 9.2.0 and backend-storage.md
[Breaking Change] Index/table ebpf_profiling_schedule added a new column ebpf_profiling_schedule_id, the H2/Mysql/Tidb/Postgres storage users are required to re-created it when bump up from previous releases.
Fix Zipkin trace query the max size of spans.
Add tls and https component IDs for Network Profiling.
Support Elasticsearch column alias for the compatibility between storage logicSharding model and no-logicSharding model.
Support MySQL monitoring.
Support PostgreSQL monitoring.
Fix query services by serviceId error when Elasticsearch storage SW_STORAGE_ES_QUERY_MAX_SIZE > 10000.
Support sending alarm messages to Discord.
Fix query history process data failure.
Optimize TTL mechanism for Elasticsearch storage, skip executed indices in one TTL rotation.
Add Kubernetes support module to share codes between modules and reduce calls to Kubernetes API server.
Bump up Kubernetes Java client to fix cve.
Adapt OpenTelemetry native metrics protocol.
[Breaking Change] rename configuration folder from otel-oc-rules to otel-rules.
[Breaking Change] rename configuration field from enabledOcRules to enabledOtelRules and environment variable name from SW_OTEL_RECEIVER_ENABLED_OC_RULES to SW_OTEL_RECEIVER_ENABLED_OTEL_RULES.
[Breaking Change] Fix JDBC TTL to delete additional tables data. SQL Database requires removing segment,segment_tag, logs, logs_tag, alarms, alarms_tag, zipkin_span, zipkin_query before OAP starts.
SQL Database: add @SQLDatabase.ExtraColumn4AdditionalEntity to support add an extra column from parent to an additional table.
Add component ID(131) for Java Micronaut plugin
Add component ID(132) for Nats java client plugin

UI

Fix query conditions for the browser logs.
Implement a URL parameter to activate tab index.
Fix clear interval fail when switch autoRefresh to off.
Optimize log tables.
Fix log detail pop-up page doesn’t work.
Optimize table widget to hide the whole metric column when no metric is set.
Implement the Event widget. Remove event menu.
Fix span detail text overlap.
Add Python Bottle Plugin Logo.
Implement an association between widgets(line, bar, area graphs) with time.
Fix tag dropdown style.
Hide the copy button when db.statement is empty.
Fix legend metrics for topology.
Dashboard: Add metrics association.
Dashboard: Fix FaaS-Root document link and topology service relation dashboard link.
Dashboard: Fix Mesh-Instance metric Throughput.
Dashboard: Fix Mesh-Service-Relation metric Throughput and Proxy Sidecar Internal Latency in Nanoseconds (Client Response).
Dashboard: Fix Mesh-Instance-Relation metric Throughput.
Enhance associations for the Event widget.
Add event widgets in dashboard where applicable.
Fix dashboard list search box not work.
Fix short time range.
Fix event widget incompatibility in Safari.
Refactor the tags component to support searching for tag keys and values.
Implement the log widget and the trace widget associate with each other, remove log tables on the trace widget.
Add log widget to general service root.
Associate the event widget with the trace and log widget.
Add the MySQL layer and update layer routers.
Fix query order for trace list.
Add a calculation to convert seconds to days. q* Add Spring Sleuth dashboard to general service instance.
Support the process dashboard and create the time range text widget.
Fix picking calendar with a wrong time range and setting a unique value for dashboard grid key.
Add PostgreSQL to Database sub-menu.
Implement the network profiling widget.
Add Micronaut icon for Java plugin.
Add Nats icon for Java plugin.
Bump moment and @vue/cli-plugin-e2e-cypress.
Add Network Profiling for Service Mesh DP instance and K8s pod panels.

Documentation

Fix invalid links in release docs.
Clean up doc about event metrics.
Add a table for metric calculations in the UI doc.
Add an explanation for alerting kernel and its in-memory window mechanism.
Add more docs for widget details.
Update alarm doc introduce configuration property key
Fix dependency license’s NOTICE and binary jar included issues in the source release.
Add eBPF CPU profiling doc.

All issues and pull requests are here

Events: Release Apache SkyWalking Rust 0.4.0

Wed, 31 Aug 2022 00:00:00 +0000

SkyWalking Rust 0.4.0 is released. Go to downloads page to find release tars.

What’s Changed

Publish release doc. by @wu-sheng in https://github.com/apache/skywalking-rust/pull/31
Set up CI and approval requirements by @wu-sheng in https://github.com/apache/skywalking-rust/pull/32
Move skywalking_proto mod to single files. by @jmjoy in https://github.com/apache/skywalking-rust/pull/33
Polish the release doc. by @wu-sheng in https://github.com/apache/skywalking-rust/pull/34
Add serde support for protobuf generated struct. by @jmjoy in https://github.com/apache/skywalking-rust/pull/35
Improve LogReporter and fix tests. by @jmjoy in https://github.com/apache/skywalking-rust/pull/36
Split tracer inner segment sender and receiver into traits. by @jmjoy in https://github.com/apache/skywalking-rust/pull/37
Switch to use nightly rustfmt. by @jmjoy in https://github.com/apache/skywalking-rust/pull/38
Change Span to refer to SpanStack, rather than TracingContext. by @jmjoy in https://github.com/apache/skywalking-rust/pull/39
Adjust the trace structure. by @jmjoy in https://github.com/apache/skywalking-rust/pull/40
Add logging. by @jmjoy in https://github.com/apache/skywalking-rust/pull/41
Upgrade dependencies. by @jmjoy in https://github.com/apache/skywalking-rust/pull/42
Add feature vendored, to auto build protoc. by @jmjoy in https://github.com/apache/skywalking-rust/pull/43
Add metrics. by @jmjoy in https://github.com/apache/skywalking-rust/pull/44
Add more GH labels as new supports by @wu-sheng in https://github.com/apache/skywalking-rust/pull/45
Bump to 0.4.0. by @jmjoy in https://github.com/apache/skywalking-rust/pull/46
Fix trace id is not transmitted. by @jmjoy in https://github.com/apache/skywalking-rust/pull/47

Events: Release Apache SkyWalking Rust 0.3.0

Thu, 21 Jul 2022 00:00:00 +0000

SkyWalking Rust 0.3.0 is released. Go to downloads page to find release tars.

What’s Changed

Update README.md by @wu-sheng in https://github.com/apache/skywalking-rust/pull/24
Improve errors. by @jmjoy in https://github.com/apache/skywalking-rust/pull/25
Add tracer. by @jmjoy in https://github.com/apache/skywalking-rust/pull/26
Move e2e to workspace. by @jmjoy in https://github.com/apache/skywalking-rust/pull/27
Auto finalize context and span when dropped. by @jmjoy in https://github.com/apache/skywalking-rust/pull/28
Add context capture and continued methods. by @jmjoy in https://github.com/apache/skywalking-rust/pull/29
Bump to 0.3.0. by @jmjoy in https://github.com/apache/skywalking-rust/pull/30

Events: [CVE-2022-36127] Release Apache SkyWalking for NodeJS 0.5.1

Mon, 18 Jul 2022 00:00:00 +0000

SkyWalking NodeJS 0.5.1 is released. Go to downloads page to find release tars.

SkyWalking NodeJS 0.5.1 is a patch release that fixed a vulnerability(CVE-2022-36127) in all previous versions <=0.5.0, we recommend all users who are using versions <=0.5.0 should upgrade to this version.

The vulnerability could cause NodeJS services that has this agent installed to be unavailable if the header includes an illegal SkyWalking header, such as

OAP is unhealthy and the downstream service’s agent can’t establish the connection.
Some sampling mechanism is activated in downstream agents.

Events: Release Apache SkyWalking Eyes 0.4.0

Mon, 11 Jul 2022 00:00:00 +0000

SkyWalking Eyes 0.4.0 is released. Go to downloads page to find release tars.

Reorganize GHA by header and dependency. (#123)
Add rust cargo support for dep command. (#121)
Support license expression in dep check. (#120)
Prune npm packages before listing all dependencies (#119)
Add support for multiple licenses in the header config section (#118)
Add excludes to license resolve config (#117)
maven: set group:artifact as dependency name and extend functions in summary template (#116)
Stablize summary context to perform consistant output (#115)
Add custom license urls for identification (#114)
Lazy initialize GitHub client for comment (#111)
Make license identifying threshold configurable (#110)
Use Google’s licensecheck to identify licenses (#107)
dep: short circuit if user declare dep license (#108)

Events: Release Apache SkyWalking for NodeJS 0.5.0

Sun, 10 Jul 2022 00:00:00 +0000

SkyWalking NodeJS 0.5.0 is released. Go to downloads page to find release tars.

Bump up grpc-node to 1.6.7 to fix CVE-2022-25878 (#85)
Fix issue #9165 express router entry duplicated (#84)
Fix skywalking s3 upload error #8824 (#82)
Improved ignore path regex (#81)
Upgrade data collect protocol (#78)
Fix wrong instance properties (#77)
Fix wrong command in release doc (#76)

Events: Release Apache SkyWalking Infra E2E 1.2.0

Sun, 10 Jul 2022 00:00:00 +0000

SkyWalking Infra E2E 1.2.0 is released. Go to downloads page to find release tars.

Features

Expand kind file path with system environment.
Support shutdown service during setup phase in compose mode.
Expand kind file path with system environment.
Support arbitrary os and arch.
Support docker-compose v2 container naming.
Support installing via go install and add install doc.
Add retry when delete kind cluster.
Upgrade to go1.18.

Bug Fixes

Fix the problem of parsing verify.retry.interval without setting value.

Documentation

Make trigger.times parameter doc more clear.

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking Python 0.8.0

Sun, 10 Jul 2022 00:00:00 +0000

SkyWalking Python 0.8.0 is released. Go to downloads page to find release tars.

Feature:
- Update mySQL plugin to support two different parameter keys. (#186)
- Add a SW_AGENT_LOG_REPORTER_SAFE_MODE option to control the HTTP basic auth credential filter (#200)
Plugins:
- Add Psycopg(3.x) support (#168)
- Add MySQL support (#178)
- Add FastAPI support (#181)
- Drop support for flask 1.x due to dependency issue in Jinja2 and EOL (#195)
- Add Bottle support (#214)
Fixes:
- Spans now correctly reference finished parents (#161)
- Remove potential password leak from Aiohttp outgoing url (#175)
- Handle error when REMOTE_PORT is missing in Flask (#176)
- Fix sw-rabbitmq TypeError when there are no headers (#182)
- Fix agent bootstrap traceback not shown in sw-python CLI (#183)
- Fix local log stack depth overridden by agent log formatter (#192)
- Fix typo that cause user sitecustomize.py not loaded (#193)
- Fix instance property wrongly shown as UNKNOWN in OAP (#194)
- Fix multiple components inconsistently named on SkyWalking UI (#199)
- Fix SW_AGENT_LOGGING_LEVEL not properly set during startup (#196)
- Unify the http tag name with other agents (#208)
- Remove namespace to instance properties and add pid property (#205)
- Fix the properties are not set correctly (#198)
- Improved ignore path regex (#210)
- Fix sw_psycopg2 register_type() (#211)
- Fix psycopg2 register_type() second arg default (#212)
- Enhance Traceback depth (#206)
- Set spans whose http code > 400 to error (#187)
Docs:
- Add a FAQ doc on how to use with uwsgi (#188)
Others:
- Refactor current Python agent docs to serve on SkyWalking official website (#162)
- Refactor SkyWalking Python to use the CLI for CI instead of legacy setup (#165)
- Add support for Python 3.10 (#167)
- Move flake configs all together (#169)
- Introduce another set of flake8 extensions (#174)
- Add E2E test coverage for trace and logging (#199)
- Now Log reporter cause_exception_depth traceback limit defaults to 10
- Enable faster CI by categorical parallelism (#170)

Events: Release Apache SkyWalking Satellite 1.0.1

Sun, 10 Jul 2022 00:00:00 +0000

SkyWalking Satellite 1.0.1 is released. Go to downloads page to find release tars.

Features

Bug Fixes

Fix metadata messed up when transferring Log data.

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking Rust 0.2.0

Mon, 04 Jul 2022 00:00:00 +0000

SkyWalking Rust 0.2.0 is released. Go to downloads page to find release tars.

What’s Changed

add a description to compile in README.md by @Shikugawa in https://github.com/apache/skywalking-rust/pull/16
Update NOTICE to 2022 by @wu-sheng in https://github.com/apache/skywalking-rust/pull/17
fix ignore /e2e/target folder by @tisonkun in https://github.com/apache/skywalking-rust/pull/18
Remove Cargo.lock, update dependencies, update submodule, disable build grpc server api. by @jmjoy in https://github.com/apache/skywalking-rust/pull/19
Enhance Trace Context machenism. by @jmjoy in https://github.com/apache/skywalking-rust/pull/20
chore(typo): fix typo in context/propagation/context.rs by @CherishCai in https://github.com/apache/skywalking-rust/pull/21
Feature(tonic-build): set tonic-build.build_server(false), do not build Server code. by @CherishCai in https://github.com/apache/skywalking-rust/pull/22
Rename crate name skywalking_rust to skywalking? by @jmjoy in https://github.com/apache/skywalking-rust/pull/23

Events: Release Apache SkyWalking Java Agent 8.11.0

Mon, 20 Jun 2022 00:00:00 +0000

SkyWalking Java Agent 8.11.0 is released. Go to downloads page to find release tars. Changes by Version

8.11.0

Fix cluster and namespace value duplicated(namespace value) in properties report.
Add layer field to event when reporting.
Remove redundant shade.package property.
Add servicecomb-2.x plugin and Testcase.
Fix NPE in gateway plugin when the timer triggers webflux webclient call.
Add an optional plugin, trace-sampler-cpu-policy-plugin, which could disable trace collecting in high CPU load.
Change the dateformat of logs to yyyy-MM-dd HH:mm:ss.SSS(was yyyy-MM-dd HH:mm:ss:SSS).
Fix NPE in elasticsearch plugin.
Grpc plugin support trace client async generic call(without grpc stubs), support Method type: UNARY、SERVER_STREAMING.
Enhance Apache ShenYu (incubating) plugin: support trace grpc,sofarpc,motan,tars rpc proxy.
Add primary endpoint name to log events.
Fix Span not finished in gateway plugin when the gateway request timeout.
Support -Dlog4j2.contextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector in gRPC log report.
Fix tcnative libraries relocation for aarch64.
Add plugin.jdbc.trace_sql_parameters into Configuration Discovery Service.
Fix argument type name of Array in postgresql-8.x-plugin from java.lang.String[] to [Ljava.lang.String;
Add type name checking in ArgumentTypeNameMatch and ReturnTypeNameMatch
Highlight ArgumentTypeNameMatch and ReturnTypeNameMatch type naming rule in docs/en/setup/service-agent/java-agent/Java-Plugin-Development-Guide.md
Fix FileWriter scheduled task NPE
Optimize gRPC Log reporter to set service name for the first element in the streaming.(No change for Kafka reporter)

All issues and pull requests are here

Events: Release Apache SkyWalking Rover 0.2.0

Mon, 13 Jun 2022 00:00:00 +0000

SkyWalking Rover 0.2.0 is released. Go to downloads page to find release tars.

Features

Support OFF_CPU Profiling.
Introduce the BTFHub module.
Update to using frequency mode to ON_CPU Profiling.
Add logs in the profiling module logical.

Bug Fixes

Fix docker based process could not be detected.

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking APM 9.1.0

Wed, 08 Jun 2022 00:00:00 +0000

SkyWalking 9.1.0 is released. Go to downloads page to find release tars.

eBPF agent(skywalking rover) is integrated in the first time

BanyanDB(skywalking native database) is integrated and passed MVP phase.
On-demand logs are provided first time in skywalking for all mesh services and k8s deployment as a zero cost log solution

Zipkin alternative is being official, and Zipkin’s HTTP APIs are supported as well as lens UI.

Changes by Version

Project

[IMPORTANT] Remove InfluxDB 1.x and Apache IoTDB 0.X as storage options, check details at here. Remove converter-moshi 2.5.0, influx-java 2.15, iotdb java 0.12.5, thrift 0.14.1, moshi 1.5.0, msgpack 0.8.16 dependencies. Remove InfluxDB and IoTDB relative codes and E2E tests.
Upgrade OAP dependencies zipkin to 2.23.16, H2 to 2.1.212, Apache Freemarker to 2.3.31, gRPC-java 1.46.0, netty to 4.1.76.
Upgrade Webapp dependencies, spring-cloud-dependencies to 2021.0.2, logback-classic to 1.2.11
[IMPORTANT] Add BanyanDB storage implementation. Notice BanyanDB is currently under active development and SHOULD NOT be used in production cluster.

OAP Server

Add component definition(ID=127) for Apache ShenYu (incubating).
Fix Zipkin receiver: Decode spans error, missing Layer for V9 and wrong time bucket for generate Service and Endpoint.
[Refactor] Move SQLDatabase(H2/MySQL/PostgreSQL), ElasticSearch and BanyanDB specific configurations out of column.
Support BanyanDB global index for entities. Log and Segment record entities declare this new feature.
Remove unnecessary analyzer settings in columns of templates. Many were added due to analyzer’s default value.
Simplify the Kafka Fetch configuration in cluster mode.
[Breaking Change] Update the eBPF Profiling task to the service level, please delete index/table: ebpf_profiling_task, process_traffic.
Fix event can’t split service ID into 2 parts.
Fix OAP Self-Observability metric GC Time calculation.
Set SW_QUERY_MAX_QUERY_COMPLEXITY default value to 1000
Webapp module (for UI) enabled compression.
[Breaking Change] Add layer field to event, report an event without layer is not allowed.
Fix ES flush thread stops when flush schedule task throws exception, such as ElasticSearch flush failed.
Fix ES BulkProcessor in BatchProcessEsDAO was initialized multiple times and created multiple ES flush schedule tasks.
HTTPServer support the handler register with allowed HTTP methods.
[Critical] Revert Enhance DataCarrier#MultipleChannelsConsumer to add priority to avoid consuming issues.
Fix the problem that some configurations (such as group.id) did not take effect due to the override order when using the kafkaConsumerConfig property to extend the configuration in Kafka Fetcher.
Remove build time from the OAP version.
Add data-generator module to run OAP in testing mode, generating mock data for testing.
Support receive Kubernetes processes from gRPC protocol.
Fix the problem that es index(TimeSeriesTable, eg. endpoint_traffic, alarm_record) didn’t create even after rerun with init-mode. This problem caused the OAP server to fail to start when the OAP server was down for more than a day.
Support autocomplete tags in traces query.
[Breaking Change] Replace all configurations **_JETTY_** to **_REST_**.
Add the support eBPF profiling field into the process entity.
E2E: fix log test miss verify LAL and metrics.
Enhance Converter mechanism in kernel level to make BanyanDB native feature more effective.
Add TermsAggregation properties collect_mode and execution_hint.
Add “execution_hint”: “map”, “collect_mode”: “breadth_first” for aggregation and topology query to improve 5-10x performance.
Clean up scroll contexts after used.
Support autocomplete tags in logs query.
Enhance Deprecated MetricQuery(v1) getValues querying to asynchronous concurrency query
Fix the pod match error when the service has multiple selector in kubernetes environment.
VM monitoring adapts the 0.50.0 of the opentelemetry-collector.
Add Envoy internal cost metrics.
Remove Layer concept from ServiceInstance.
Remove unnecessary onCompleted on gRPC onError callback.
Remove Layer concept form Process.
Update to list all eBPF profiling schedulers without duration.
Storage(ElasticSearch): add search options to tolerate inexisting indices.
Fix the problem that MQ has the wrong Layer type.
Fix NoneStream model has wrong downsampling(was Second, should be Minute).
SQL Database: provide @SQLDatabase.AdditionalEntity to support create additional tables from a model.
[Breaking Change] SQL Database: remove SQL Database config maxSizeOfArrayColumn and numOfSearchableValuesPerTag.
[Breaking Change] SQL Database: move Tags list from Segment,Logs,Alarms to their additional table.
[Breaking Change] Remove total field in Trace, Log, Event, Browser log, and alarm list query.
Support OFF_CPU eBPF Profiling.
Fix SumAggregationBuilder#build should use the SumAggregation rather than MaxAggregation.
Add TiDB, OpenSearch, Postgres storage optional to Trace and eBPF Profiling E2E testing.
Add OFF CPU eBPF Profiling E2E Testing.
Fix searchableTag as rpc.status_code and http.status_code. status_code had been removed.
Fix scroll query failure exception.
Add profileDataQueryBatchSize config in Elasticsearch Storage.
Add APIs to query Pod log on demand.
Remove OAL for events.
Simplify the format index name logical in ES storage.
Add instance properties extractor in MAL.
Support Zipkin traces collect and zipkin traces query API.
[Breaking Change] Zipkin receiver mechanism changes and traces do not stream into OAP Segment anymore.

UI

General service instance: move Thread Pool from JVM to Overview, fix JVM GC Count calculation.
Add Apache ShenYu (incubating) component LOGO.
Show more metrics on service/instance/endpoint list on the dashboards.
Support average values of metrics on the service/list/endpoint table widgets, with pop-up linear graph.
Fix viewLogs button query no data.
Fix UTC when page loads.
Implement the eBPF profile widget on dashboard.
Optimize the trace widget.
Avoid invalid query for topology metrics.
Add the alarm and log tag tips.
Fix spans details and task logs.
Verify query params to avoid invalid queries.
Mobile terminal adaptation.
Fix: set dropdown for the Tab widget, init instance/endpoint relation selectors, update sankey graph.
Add eBPF Profiling widget into General service, Service Mesh and Kubernetes tabs.
Fix jump to endpoint-relation dashboard template.
Fix set graph options.
Remove the Layer filed from the Instance and Process.
Fix date time picker display when set hour to 0.
Implement tags auto-complete for Trace and Log.
Support multiple trees for the flame graph.
Fix the page doesn’t need to be re-rendered when the url changes.
Remove unexpected data for exporting dashboards.
Fix duration time.
Remove the total field from query conditions.
Fix minDuration and maxDuration for the trace filter.
Add Log configuration for the browser templates.
Fix query conditions for the browser logs.
Add Spanish Translation.
Visualize the OFF CPU eBPF profiling.
Add Spanish language to UI.
Sort spans with startTime or spanId in a segment.
Visualize a on-demand log widget.
Fix activate the correct tab index after renaming a Tabs name.
FaaS dashboard support on-demand log (OpenFunction/functions-framework-go version > 0.3.0).

Documentation

Add eBPF agent into probe introduction.

All issues and pull requests are here

Events: Release Apache SkyWalking BanyanDB 0.1.0

Sun, 05 Jun 2022 00:00:00 +0000

SkyWalking BanyanDB 0.1.0 is released. Go to downloads page to find release tars.

Features

BanyanD is the server of BanyanDB
- TSDB module. It provides the primary time series database with a key-value data module.
- Stream module. It implements the stream data model’s writing.
- Measure module. It implements the measure data model’s writing.
- Metadata module. It implements resource registering and property CRUD.
- Query module. It handles the querying requests of stream and measure.
- Liaison module. It’s the gateway to other modules and provides access endpoints to clients.
gRPC based APIs
Document
- API reference
- Installation instrument
- Basic concepts
Testing
- UT
- E2E with Java Client and OAP

Events: Release Apache SkyWalking BanyanDB Java Client 0.1.0

Thu, 26 May 2022 00:00:00 +0000

SkyWalking BanyanDB 0.1.0 is released. Go to downloads page to find release tars.

Features

Support Measure, Stream and Property Query and Write APIs
Support Metadata Management APIs for Measure, Stream, IndexRule and IndexRuleBinding

Chores

Set up GitHub actions to check code styles, licenses, and tests.

Events: Release Apache SkyWalking Rover 0.1.0

Sat, 21 May 2022 00:00:00 +0000

SkyWalking Rover 0.1.0 is released. Go to downloads page to find release tars.

Features

Support detect processes in scanner or kubernetes mode.
Support profiling C, C++, Golang, and Rust service.

Bug Fixes

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking Satellite 1.0.0

Sat, 21 May 2022 00:00:00 +0000

SkyWalking Satellite 1.0.0 is released. Go to downloads page to find release tars.

Features

Add the compat protocol receiver for the old version of agents.
Support transmit the native eBPF Process and Profiling protocol.
Change the name of plugin that is not well-named.

Bug Fixes

Fix Metadata lost in the Native Meter protocol.

Issues and PR

All issues are here
All and pull requests are here

Events: Release Apache SkyWalking Eyes 0.3.0

Sat, 14 May 2022 00:00:00 +0000

SkyWalking Eyes 0.3.0 is released. Go to downloads page to find release tars.

Dependency License
- Fix license check in go library testify (#93)
License Header
- fix command supports more languages:
  - Add comment style for cmake language (#86)
  - Add comment style for hcl (#89)
  - Add mpl-2.0 header template (#87)
  - Support fix license header for tcl files (#102)
  - Add python docstring comment style (#100)
  - Add comment style for makefile & editorconfig (#90)
- Support config license header comment style (#97)
- Trim leading and trailing newlines before rewrite license header cotent (#94)
- Replace already existing license header based on pattern (#98)
- [docs] add the usage for config the license header comment style (#99)
Project
- Obtain default github token in github actions (#82)
- Add tests for bare spdx license header content (#92)
- Add github action step summary for better experience (#104)
- Adds an option to the action to run in fix mode (#84)
- Provide --summary flag to generate the license summary file (#103)
- Add .exe suffix to windows binary (#101)
- Fix wrong file path and exclude binary files in src release (#81)
- Use t.tempdir to create temporary test directory (#95)
- Config: fix incorrect log message (#91)
- [docs] correct spelling mistakes (#96)

Events: Release Apache SkyWalking Kubernetes Event Exporter 1.0.0

Mon, 25 Apr 2022 00:00:00 +0000

SkyWalking Kubernetes Event Exporter 1.0.0 is released. Go to downloads page to find release tars.

Add Apache SkyWalking exporter to export events into SkyWalking OAP.
Add console exporter for debugging purpose.

Events: Release Apache SkyWalking Java Agent 8.10.0

Fri, 15 Apr 2022 00:00:00 +0000

SkyWalking Java Agent 8.10.0 is released. Go to downloads page to find release tars. Changes by Version

8.10.0

[Important] Namespace represents a subnet, such as kubernetes namespace, or 172.10... Make namespace concept as a part of service naming format.
[Important] Add cluster concept, also as a part of service naming format. The cluster name would be
1. Add as {@link #SERVICE_NAME} suffix.
2. Add as exit span’s peer, ${CLUSTER} / original peer
3. Cross Process Propagation Header’s value addressUsedAtClient[index=8] (Target address of this request used on the client end).
Support Undertow thread pool metrics collecting.
Support Tomcat thread pool metric collect.
Remove plugin for ServiceComb Java Chassis 0.x
Add Guava EventBus plugin.
Fix Dubbo 3.x plugin’s tracing problem.
Fix the bug that maybe generate multiple trace when invoke http request by spring webflux webclient.
Support Druid Connection pool metrics collecting.
Support HikariCP Connection pool metrics collecting.
Support Dbcp2 Connection pool metrics collecting.
Ignore the synthetic constructor created by the agent in the Spring patch plugin.
Add witness class for vertx-core-3.x plugin.
Add witness class for graphql plugin.
Add vertx-core-4.x plugin.
Renamed graphql-12.x-plugin to graphql-12.x-15.x-plugin and graphql-12.x-scenario to graphql-12.x-15.x-scenario.
Add graphql-16plus plugin.
[Test] Support to configure plugin test base images.
[Breaking Change] Remove deprecated agent.instance_properties configuration. Recommend agent.instance_properties_json.
The namespace and cluster would be reported as instance properties, keys are namespace and cluster. Notice, if instance_properties_json includes these two keys, they would be overrided by the agent core.
[Breaking Change] Remove the namespace from cross process propagation key.
Make sure the parent endpoint in tracing context from existing first ENTRY span, rather than first span only.
Fix the bug that maybe causing memory leak and repeated traceId when use gateway-2.1.x-plugin or gateway-3.x-plugin.
Fix Grpc 1.x plugin could leak context due to gRPC cancelled.
Add JDK ThreadPoolExecutor Plugin.
Support default database(not set through JDBC URL) in mysql-5.x plugin.

Documentation

Add link about java agent injector.
Update configurations doc, remove agent.instance_properties[key]=value.
Update configurations doc, add agent.cluster and update agent.namespace.

All issues and pull requests are here

Events: Release Apache SkyWalking Client JS 0.8.0

Sun, 10 Apr 2022 00:00:00 +0000

SkyWalking Client JS 0.8.0 is released. Go to downloads page to find release tars.

Fix fmp metric.
Add e2e tese based on skywaling-infra-e2e.
Update metric and events.
Remove ServiceTag by following SkyWalking v9 new layer model.

Events: Release Apache SkyWalking APM 9.0.0

Sat, 09 Apr 2022 00:00:00 +0000

SkyWalking 9.0.0 is released. Go to downloads page to find release tars.

SkyWalking v9 is the next main stream of the OAP and UI.

Starting from v9, SkyWalking introduces the new core concept Layer. A layer represents an abstract framework in computer science, such as Operating System(OS_LINUX layer), Kubernetes(k8s layer). All detected instances belong to a layer to represent the running environment of this instance, the service would have one or multiple layer definitions according to its instances.

RocketBot UI has officially been replaced by the Booster UI.

Changes by Version

Project

Upgrade log4j2 to 2.17.1 for CVE-2021-44228, CVE-2021-45046, CVE-2021-45105 and CVE-2021-44832. This CVE only effects on JDK if JNDI is opened in default. Notice, using JVM option -Dlog4j2.formatMsgNoLookups=true or setting the LOG4J_FORMAT_MSG_NO_LOOKUPS=”true” environment variable also avoids CVEs.
Upgrade maven-wrapper to 3.1.0, maven to 3.8.4 for performance improvements and ARM more native support.
Exclude unnecessary libs when building under JDK 9+.
Migrate base Docker image to eclipse-temurin as adoptopenjdk is deprecated.
Add E2E test under Java 17.
Upgrade protoc to 3.19.2.
Add Istio 1.13.1 to E2E test matrix for verification.
Upgrade Apache parent pom version to 25.
Use the plugin version defined by the Apache maven parent.
- Upgrade maven-dependency-plugin to 3.2.0.
- Upgrade maven-assembly-plugin to 3.3.0.
- Upgrade maven-failsafe-plugin to 2.22.2.
- Upgrade maven-surefire-plugin to 2.22.2.
- Upgrade maven-jar-plugin to 3.2.2.
- Upgrade maven-enforcer-plugin to 3.0.0.
- Upgrade maven-compiler-plugin to 3.10.0.
- Upgrade maven-resources-plugin to 3.2.0.
- Upgrade maven-source-plugin to 3.2.1.
Update codeStyle.xml to fix incompatibility on M1’s IntelliJ IDEA 2021.3.2.
Update frontend-maven-plugin to 1.12 and npm to 16.14.0 for booster UI build.
Improve CI with the GHA new feature “run failed jobs”.
Fix ./mvnw compile not work if ./mvnw install is not executed at least once.
Add JD_PRESERVE_LINE_FEEDS=true in official code style file.
Upgrade OAP dependencies gson(2.9.0), guava(31.1), jackson(2.13.2), protobuf-java(3.18.4), commons-io(2.7), postgresql(42.3.3).
Remove commons-pool and commons-dbcp from OAP dependencies(Not used before).
Upgrade webapp dependencies gson(2.9.0), spring boot(2.6.6), jackson(2.13.2.2), spring cloud(2021.0.1), Apache httpclient(4.5.13).

OAP Server

Fix potential NPE in OAL string match and a bug when right-hand-side variable includes double quotes.
Bump up Armeria version to 1.14.1 to fix CVE.
Polish ETCD cluster config environment variables.
Add the analysis of metrics in Satellite MetricsService.
Fix Can't split endpoint id into 2 parts bug for endpoint ID. In the TCP in service mesh observability, endpoint name doesn’t exist in TCP traffic.
Upgrade H2 version to 2.0.206 to fix CVE-2021-23463 and GHSA-h376-j262-vhq6.
Extend column name override mechanism working for ValueColumnMetadata.
Introduce new concept Layer and removed NodeType. More details refer to v9-version-upgrade.
Fix query sort metrics failure in H2 Storage.
Bump up grpc to 1.43.2 and protobuf to 3.19.2 to fix CVE-2021-22569.
Add source layer and dest layer to relation.
Follow protocol grammar fix GCPhrase -> GCPhase.
Set layer to mesh relation.
Add FAAS to SpanLayer.
Adjust e2e case for V9 core.
Support ZGC GC time and count metric collecting.
Sync proto buffers files from upstream Envoy (Related to https://github.com/envoyproxy/envoy/pull/18955).
Bump up GraphQL related dependencies to latest versions.
Add normal to V9 service meta query.
Support scope=ALL catalog for metrics.
Bump up H2 to 2.1.210 to fix CVE-2022-23221.
E2E: Add normal field to Service.
Add FreeSql component ID(3017) of dotnet agent.
E2E: verify OAP cluster model data aggregation.
Fix SelfRemoteClient self observing metrics.
Add env variables SW_CLUSTER_INTERNAL_COM_HOST and SW_CLUSTER_INTERNAL_COM_PORT for cluster selectors zookeeper ,consul,etcd and nacos.
Doc update: configuration-vocabulary,backend-cluster about env variables SW_CLUSTER_INTERNAL_COM_HOST and SW_CLUSTER_INTERNAL_COM_PORT.
Add Python MysqlClient component ID(7013) with mapping information.
Support Java thread pool metrics analysis.
Fix IoTDB Storage Option insert null index value.
Set the default value of SW_STORAGE_IOTDB_SESSIONPOOL_SIZE to 8.
Bump up iotdb-session to 0.12.4.
Bump up PostgreSQL driver to fix CVE.
Add Guava EventBus component ID(123) of Java agent.
Add OpenFunction component ID(5013).
Expose configuration responseTimeout of ES client.
Support datasource metric analysis.
[Breaking Change] Keep the endpoint avg resp time meter name the same with others scope. (This may break 3rd party integration and existing alarm rule settings)
Add Python FastAPI component ID(7014).
Support all metrics from MAL engine in alarm core, including Prometheus, OC receiver, meter receiver.
Allow updating non-metrics templates when structure changed.
Set default connection timeout of ElasticSearch to 3000 milliseconds.
Support ElasticSearch 8 and add it into E2E tests.
Disable indexing for field alarm_record.tags_raw_data of binary type in ElasticSearch storage.
Fix Zipkin receiver wrong condition for decoding gzip.
Add a new sampler (possibility) in LAL.
Unify module name receiver_zipkin to receiver-zipkin, remove receiver_jaeger from application.yaml.
Introduce the entity of Process type.
Set the length of event#parameters to 2000.
Limit the length of Event#parameters.
Support large service/instance/networkAddressAlias list query by using ElasticSearch scrolling API, add metadataQueryBatchSize to configure scrolling page size.
Change default value of metadataQueryMaxSize from 5000 to 10000
Replace deprecated Armeria API BasicToken.of with AuthToken.ofBasic.
Implement v9 UI template management protocol.
Implement process metadata query protocol.
Expose more ElasticSearch health check related logs to help to diagnose Health check fails. reason: No healthy endpoint.
Add source event generated metrics to SERVICE_CATALOG_NAME catalog.
[Breaking Change] Deprecate All from OAL source.
[Breaking Change] Remove SRC_ALL: 'All' from OAL grammar tree.
Remove all_heatmap and all_percentile metrics.
Fix ElasticSearch normal index couldn’t apply mapping and update.
Enhance DataCarrier#MultipleChannelsConsumer to add priority for the channels, which makes OAP server has a better performance to activate all analyzers on default.
Activate receiver-otel#enabledOcRules receiver with k8s-node,oap,vm rules on default.
Activate satellite,spring-sleuth for agent-analyzer#meterAnalyzerActiveFiles on default.
Activate receiver-zabbix receiver with agent rule on default.
Replace HTTP server (GraphQL, agent HTTP protocol) from Jetty with Armeria.
[Breaking Change] Remove configuration restAcceptorPriorityDelta (env var: SW_RECEIVER_SHARING_JETTY_DELTA , SW_CORE_REST_JETTY_DELTA).
[Breaking Change] Remove configuration graphql/path (env var: SW_QUERY_GRAPHQL_PATH).
Add storage column attribute indexOnly, support ElasticSearch only index and not store some fields.
Add indexOnly=true to SegmentRecord.tags, AlarmRecord.tags, AbstractLogRecord.tags, to reduce unnecessary storage.
[Breaking Change] Remove configuration restMinThreads (env var: SW_CORE_REST_JETTY_MIN_THREADS , SW_RECEIVER_SHARING_JETTY_MIN_THREADS).
Refactor the core Builder mechanism, new storage plugin could implement their own converter and get rid of hard requirement of using HashMap to communicate between data object and database native structure.
[Breaking Change] Break all existing 3rd-party storage extensions.
Remove hard requirement of BASE64 encoding for binary field.
Add complexity limitation for GraphQL query to avoid malicious query.
Add Column.shardingKeyIdx for column definition for BanyanDB.

Sharding key is used to group time series data per metric of one entity in one place (same sharding and/or same 
row for column-oriented database).
For example,
ServiceA's traffic gauge, service call per minute, includes following timestamp values, then it should be sharded by service ID
[ServiceA(encoded ID): 01-28 18:30 values-1, 01-28 18:31 values-2, 01-28 18:32 values-3, 01-28 18:32 values-4]

BanyanDB is the 1st storage implementation supporting this. It would make continuous time series metrics stored closely and compressed better.

NOTICE, this sharding concept is NOT just for splitting data into different database instances or physical files.

Support ElasticSearch template mappings properties parameters and _source update.
Implement the eBPF profiling query and data collect protocol.
[Breaking Change] Remove Deprecated responseCode from sources, including Service, ServiceInstance, Endpoint
Enhance endpoint dependency analysis to support cross threads cases. Refactor span analysis code structures.
Remove isNotNormal service requirement when use alias to merge service topology from client side. All RPCs’ peer services from client side are always normal services. This cause the topology is not merged correctly.
Fix event type of export data is incorrect, it was EventType.TOTAL always.
Reduce redundancy ThreadLocal in MAL core. Improve MAL performance.
Trim tag’s key and value in log query.
Refactor IoTDB storage plugin, add IoTDBDataConverter and fix ModifyCollectionInEnhancedForLoop bug.
Bump up iotdb-session to 0.12.5.
Fix the configuration of Aggregation and GC Count metrics for oap self observability
E2E: Add verify OAP eBPF Profiling.
Let multiGet could query without tag value in the InfluxDB storage plugin.
Adjust MAL for V9, remove some groups, add a new Service function for the custom delimiter.
Add service catalog DatabaseSlowStatement.
Add Error Prone Annotations dependency to suppress warnings, which are not errors.

UI

[Breaking Change] Introduce Booster UI, remove RocketBot UI.
[Breaking Change] UI Templates have been redesigned totally. GraphQL query is minimal compatible for metadata and metrics query.
Remove unused jars (log4j-api.jar) in classpath.
Bump up netty version to fix CVE.
Add Database Connection pool metric.
Re-implement UI template initialization for Booster UI.
Add environment variable SW_ENABLE_UPDATE_UI_TEMPLATE to control user edit UI template.
Add the Self Observability template of the SkyWalking Satellite.
Add the template of OpenFunction observability.

Documentation

Reconstruction doc menu for v9.
Update backend-alarm.md doc, support op “=” to “==”.
Update backend-meter.md doc .
Add <STAM: Enhancing Topology Auto Detection For A Highly Distributed and Large-Scale Application System> paper.
Add Academy menu for recommending articles.
Remove All source relative document and examples.
Update Booster UI’s dependency licenses.
Add profiling doc, and remove service mesh intro doc(not necessary).
Add a doc for virtual database.
Rewrite UI introduction.
Update k8s-monitoring, backend-telemetry and v9-version-upgrade doc for v9.

All issues and pull requests are here

Events: Release Apache SkyWalking CLI 0.10.0

Wed, 06 Apr 2022 00:00:00 +0000

SkyWalking CLI 0.10.0 is released. Go to downloads page to find release tars.

Features

Allow setting start and end with relative time (#128)
Add some commands for the browser (#126)
Add the sub-command service layer to query services according to layer (#133)
Add the sub-command layer list to query layer list (#133)
Add the sub-command instance get to query single instance (#134)
Add the sub-command endpoint get to query single endpoint info (#134)
Change the GraphQL method to the v9 version according to the server version (#134)
Add normal field to Service entity (#136)
Add the command process for query Process metadata (#137)
Add the command profiling ebpf for process ebpf profiling (#138)
Support getprofiletasklogs query (#125)
Support query list alarms (#127)
[Breaking Change] Update the command profile as a sub-command profiling trace, and update profiled-analyze command to analysis (#138)
profiling ebpf/trace analysis generates the profiling graph HTML on default and saves it to the current work directory (#138)

Bug Fixes

Fix quick install (#131)
Set correct go version in publishing snapshot docker image (#124)
Stop build kit container after finishing (#130)

Chores

Add cross platform build targets (#129)
Update download host (#132)

Events: Open Source Promotion Plan 2022 -- Project List

Mon, 04 Apr 2022 00:00:00 +0000

SkyWalking is an open-source APM system, including monitoring, tracing, and diagnosing capabilities for distributed systems in Cloud Native architecture. It covers monitoring for Linux, Kubernetes, Service Mesh, Serverless/Function-as-a-Service, agent-attached services, and browsers. With data covering traces, metrics, logs, and events, SkyWalking is a full-stack observability APM system.

Open Source Promotion Plan is a summer program organized and long-term supported by Open Source Software Supply Chain Promotion Plan. It aims to encourage college students to actively participate in developing and maintaining open-source software and promote the vigorous development of an excellent open-source software community.

Apache SkyWalking has been accepted in OSPP 2022

Project	Description	Difficulty	Mentor / E-mail	Expectation	Tech. Requirements	Repository
SkyAPM-PHP	Add switches for monitoring items	Advanced Level	Yanlong He / heyanlong@apache.org	Complete project development work	C++, GO, PHP	https://github.com/SkyAPM/SkyAPM-php-sdk
SkyWalking-Infra-E2E	Optimize verifier	Normal Level	Huaxi Jiang / hoshea@apache.org	1. Continue to verify cases when other cases fail 2. Merge retry outputs 3. Prettify verify results’ output	Go	https://github.com/apache/skywalking-infra-e2e
SkyWalking	Metrics anomaly detection with machine learning	Advanced Level	Yihao Chen / yihaochen@apache.org	An MVP version of ML-powered metrics anomaly detection using dynamic baselines and thresholds	Python, Java	https://github.com/apache/skywalking
SkyWalking Python	Collect PVM metrics and send the metrics to OAP backend, configure dashboard in UI	Normal Level	Zhenxu Ke / kezhenxu94@apache.org	Core Python VM metrics should be collected and displayed in SkyWalking.	Python	https://github.com/apache/skywalking-python issue
SkyWalking BanyanDB	Command line tools for BanyanDB	Normal Level	Hongtao Gao / hanahmily@apache.org	Command line tools should access relevant APIs to manage resources and online data.	Go	https://github.com/apache/skywalking-banyandb
SkyWalking SWCK	CRD and controller for BanyanDB	Advance Level	Ye Cao / dashanji@apache.org	CRD and controller provision BanyanDB as the native Storage resource.	Go	https://github.com/apache/skywalking-swck
SkyAPM-Go2sky	Collect golang metrics such as gc, goroutines and threads, and send the the metrics to OAP backend, configure dashboard in UI	Normal Level	Wei Zhang / zhangwei24@apache.org	Core golang metrics should be collected and displayed in SkyWalking.	Go	https://github.com/SkyAPM/go2sky
SkyWalking	Collect system metrics such as system_load, cpu_usage, mem_usage from telegraf and send the metrics to OAP backend, configure dashboard in UI	Normal Level	Haoyang Liu / liuhaoyangzz@apache.org	System metrics should be collected and displayed in SkyWalking.	Java	https://github.com/apache/skywalking

Mentors could submit pull requests to update the above list.

Contact the community

You could send emails to mentor’s personal email to talk about the project and details. The official mail list of the community is dev@skywalking.apache.org. You need to subscribe to the mail list to get all replies. Send mail to dev-suscribe@skywalking.apache.org and follow the replies.

Events: Release Apache SkyWalking for NodeJS 0.4.0

Sun, 13 Mar 2022 00:00:00 +0000

SkyWalking NodeJS 0.4.0 is released. Go to downloads page to find release tars.

Fix mysql2 plugin install error. (#74)
Update IORedis Plugin, fill dbinstance tag as host if condition.select doesn’t exist. (#73)
Experimental AWS Lambda Function support. (#70)
Upgrade dependencies to fix vulnerabilities. (#68)
Add lint pre-commit hook and migrate to eslint. (#66, #67)
Bump up gRPC version, and use its new release repository. (#65)
Regard baseURL when in Axios Plugin. (#63)
Add an API to access the trace id. (#60)
Use agent test tool snapshot Docker image instead of building in CI. (#59)
Wrapped IORedisPlugin call in try/catch. (#58)

Events: Release Apache SkyWalking Client Rust 0.1.0

Thu, 17 Feb 2022 00:00:00 +0000

SkyWalking Client Rust 0.1.0 is released. Go to downloads page to find release tars.

Events: Release Apache SkyWalking Java Agent 8.9.0

Sun, 30 Jan 2022 00:00:00 +0000

SkyWalking Java Agent 8.9.0 is released. Go to downloads page to find release tars. Changes by Version

8.9.0

Support Transaction and fix duplicated methods enhancements for jedis-2.x plugin.
Add ConsumerWrapper/FunctionWrapper to support CompletableFuture.x.thenAcceptAsync/thenApplyAsync.
Build CLI from Docker instead of source codes, add alpine based Docker image.
Support set instance properties in json format.
Upgrade grpc-java to 1.42.1 and protoc to 3.17.3 to allow using native Mac osx-aarch_64 artifacts.
Add doc about system environment variables to configurations.md
Avoid ProfileTaskChannelService.addProfilingSnapshot throw IllegalStateException(Queue full)
Increase ProfileTaskChannelService.snapshotQueue default size from 50 to 4500
Support 2.8 and 2.9 of pulsar client.
Add dubbo 3.x plugin.
Fix TracePathMatcher should match pattern “**” with paths end by “/”
Add support returnedObj expression for apm-customize-enhance-plugin
Fix the bug that httpasyncclient-4.x-plugin puts the dirty tracing context in the connection context
Compatible with the versions after dubbo-2.7.14
Follow protocol grammar fix GCPhrase -> GCPhase.
Support ZGC GC time and count metric collect. (Require 9.0.0 OAP)
Support configuration for collecting redis parameters for jedis-2.x and redisson-3.x plugin.
Migrate base images to Temurin and add images for ARM.
(Plugin Test) Fix compiling issues in many plugin tests due to they didn’t lock the Spring version, and Spring 3 is incompatible with 2.x APIs and JDK8 compiling.
Support ShardingSphere 5.0.0
Bump up gRPC to 1.44.0, fix relative CVEs.

Documentation

Add a FAQ, Why is -Djava.ext.dirs not supported?.

All issues and pull requests are here

Events: Release Apache SkyWalking Cloud on Kubernetes 0.6.1

Thu, 20 Jan 2022 00:00:00 +0000

SkyWalking Cloud on Kubernetes 0.6.1 is released. Go to downloads page to find release tars.

Bugs
- Fix could not deploy metrics adapter to GKE

Events: Release Apache SkyWalking Cloud on Kubernetes 0.6.0

Fri, 14 Jan 2022 00:00:00 +0000

SkyWalking Cloud on Kubernetes 0.6.0 is released. Go to downloads page to find release tars.

Features
- Add the Satellite CRD, webhooks and controller
Bugs
- Update release images to set numeric user id
- Fix the satellite config not support number error
- Use env JAVA_TOOL_OPTIONS to replace AGENT_OPTS
Chores
- Add stabilization windows feature in satellite HPA documentation