Skip to content

Add _meta information to Kubernetes fields #1289

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ChrsMark merged 15 commits into from
Jul 6, 2021
Merged

Add _meta information to Kubernetes fields #1289

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
625d53a
Add apiserver
ChrsMark Jul 5, 2021
44a4432
Add container
ChrsMark Jul 5, 2021
03f9717
Add controllemanager
ChrsMark Jul 5, 2021
b3e5dcb
Add event
ChrsMark Jul 5, 2021
473d834
Add node
ChrsMark Jul 5, 2021
d4489d4
Add pod
ChrsMark Jul 5, 2021
be78ecd
Add proxy
ChrsMark Jul 5, 2021
a511e53
Add scheduler
ChrsMark Jul 5, 2021
4eead32
Add state_container
ChrsMark Jul 5, 2021
d93cfb1
Add more datastreams
ChrsMark Jul 6, 2021
6b88833
build
ChrsMark Jul 6, 2021
dbd97b6
bump up version and add changelog
ChrsMark Jul 6, 2021
6c1fd3b
fix changelog
ChrsMark Jul 6, 2021
c2a4945
fix typo
ChrsMark Jul 6, 2021
0a133ff
Fix versioning
ChrsMark Jul 6, 2021
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/kubernetes/changelog.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "0.7.0"
changes:
- description: Add _meta information to Kubernetes fields
type: enhancement
link: https://github.com/elastic/integrations/pull/1289
- version: "0.6.0"
changes:
- description: Introduce kubernetes package granularity using input_groups
Expand Down
30 changes: 30 additions & 0 deletions packages/kubernetes/data_stream/apiserver/fields/fields.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -66,20 +66,27 @@
fields:
- name: cpu.sec
type: double
metric_type: counter
description: CPU seconds
- name: memory.resident.bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: Bytes in resident memory
- name: memory.virtual.bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: Bytes in virtual memory
- name: fds.open.count
type: long
metric_type: gauge
description: Number of open file descriptors
- name: started.sec
type: double
metric_type: gauge
description: Seconds since the process started
- name: http
type: group
Expand All @@ -89,72 +96,95 @@
description: Request duration microseconds percentiles
- name: request.duration.us.sum
type: double
metric_type: counter
unit: micros
description: Request duration microseconds cumulative sum
- name: request.duration.us.count
type: long
metric_type: counter
unit: micros
description: Request count for duration
- name: request.size.bytes.percentile.*
type: object
description: Request size percentiles
- name: request.size.bytes.sum
type: long
format: bytes
unit: byte
metric_type: counter
description: Request size cumulative sum
- name: request.size.bytes.count
type: long
unit: byte
metric_type: counter
description: Request count for size
- name: response.size.bytes.percentile.*
type: object
description: Response size percentiles
- name: response.size.bytes.sum
type: long
format: bytes
unit: byte
metric_type: counter
description: Response size cumulative sum
- name: response.size.bytes.count
type: long
metric_type: counter
description: Response count
- name: request.count
type: long
metric_type: counter
description: Request count for response
- name: client.request.count
type: long
metric_type: counter
description: Number of requests as client
- name: request
type: group
fields:
- name: count
type: long
metric_type: counter
description: Number of requests
- name: latency.sum
type: long
metric_type: counter
description: Requests latency, sum of latencies in microseconds
- name: latency.count
type: long
metric_type: counter
description: Request latency, number of requests
- name: latency.bucket.*
type: object
description: Request latency histogram buckets
- name: duration.us.sum
type: long
metric_type: counter
description: Request duration, sum in microseconds
- name: duration.us.count
type: long
metric_type: counter
description: Request duration, number of operations
- name: duration.us.bucket.*
type: object
description: Request duration, histogram buckets
- name: current.count
type: long
metric_type: counter
description: Inflight requests
- name: longrunning.count
type: long
metric_type: counter
description: Number of requests active long running requests
- name: etcd.object.count
type: long
metric_type: gauge
description: Number of kubernetes objects at etcd
- name: audit.event.count
type: long
metric_type: counter
description: Number of audit events
- name: audit.rejected.count
type: long
metric_type: counter
description: Number of audit rejected events
36 changes: 36 additions & 0 deletions packages/kubernetes/data_stream/container/fields/fields.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,20 +16,26 @@
fields:
- name: ns
type: long
metric_type: gauge
description: |
Container CPU Core usage nanoseconds
- name: nanocores
type: long
metric_type: gauge
description: |
CPU used nanocores
- name: node.pct
type: scaled_float
format: percent
unit: percent
metric_type: gauge
description: |
CPU usage as a percentage of the total node allocatable CPU
- name: limit.pct
type: scaled_float
format: percent
unit: percent
metric_type: gauge
description: |
CPU usage as a percentage of the defined limit for the container (or total node allocatable CPU if unlimited)
- name: logs
Expand All @@ -41,6 +47,8 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Logs available capacity in bytes
- name: capacity
Expand All @@ -49,6 +57,8 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Logs total capacity in bytes
- name: used
Expand All @@ -57,21 +67,26 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Logs used capacity in bytes
- name: inodes
type: group
fields:
- name: count
type: long
metric_type: gauge
description: |
Total available inodes
- name: free
type: long
metric_type: gauge
description: |
Total free inodes
- name: used
type: long
metric_type: gauge
description: |
Total used inodes
- name: memory
Expand All @@ -83,6 +98,8 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Total available memory
- name: usage
Expand All @@ -91,16 +108,22 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Total memory usage
- name: node.pct
type: scaled_float
format: percent
unit: percent
metric_type: gauge
description: |
Memory usage as a percentage of the total node allocatable memory
- name: limit.pct
type: scaled_float
format: percent
unit: percent
metric_type: gauge
description: |
Memory usage as a percentage of the defined limit for the container (or total node allocatable memory if unlimited)
- name: rss
Expand All @@ -109,6 +132,8 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
RSS memory usage
- name: workingset
Expand All @@ -117,14 +142,18 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Working set memory usage
- name: pagefaults
type: long
metric_type: counter
description: |
Number of page faults
- name: majorpagefaults
type: long
metric_type: counter
description: |
Number of major page faults
- name: rootfs
Expand All @@ -136,6 +165,8 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Root filesystem total capacity in bytes
- name: available
Expand All @@ -144,6 +175,8 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Root filesystem total available in bytes
- name: used
Expand All @@ -152,12 +185,15 @@
- name: bytes
type: long
format: bytes
unit: byte
metric_type: gauge
description: |
Root filesystem total used in bytes
- name: inodes
type: group
fields:
- name: used
type: long
metric_type: gauge
description: |
Used inodes
Loading