init commit
|
@ -0,0 +1,227 @@
|
||||||
|
# Reverse Image Search Based on Milvus & Towhee
|
||||||
|
|
||||||
|
This demo uses [towhee](https://github.com/towhee-io/towhee) image embedding operator to extract image features by ResNet50, and uses Milvus to build a system that can perform reverse image search.
|
||||||
|
|
||||||
|
The system architecture is as below:
|
||||||
|
|
||||||
|
<img src="pic/workflow.png" height = "500" alt="arch" align=center />
|
||||||
|
|
||||||
|
|
||||||
|
## Data Source
|
||||||
|
|
||||||
|
This demo uses the PASCAL VOC image set, which contains 17125 images with 20 categories: human; animals (birds, cats, cows, dogs, horses, sheep); transportation (planes, bikes, boats, buses, cars, motorcycles, trains); household (bottles, chairs, tables, pot plants, sofas, TVs).
|
||||||
|
|
||||||
|
Dataset size: ~ 2 GB.
|
||||||
|
|
||||||
|
Download location: https://drive.google.com/file/d/1n_370-5Stk4t0uDV1QqvYkcvyV8rbw0O/view?usp=sharing
|
||||||
|
|
||||||
|
> Note: You can also use other images for testing. This system supports the following formats: .jpg and .png.
|
||||||
|
|
||||||
|
## Local Deployment
|
||||||
|
|
||||||
|
### Requirements
|
||||||
|
|
||||||
|
- [Milvus 2.2.10](https://milvus.io/)
|
||||||
|
- [Towhee](https://towhee.io/)
|
||||||
|
- [MySQL](https://hub.docker.com/r/mysql/mysql-server)
|
||||||
|
- [Python3](https://www.python.org/downloads/)
|
||||||
|
- [Docker](https://docs.docker.com/engine/install/)
|
||||||
|
- [Docker Compose](https://docs.docker.com/compose/install/)
|
||||||
|
|
||||||
|
## Option 1: Deploy with Docker Compose
|
||||||
|
|
||||||
|
The reverse image search system requires Milvus, MySQL, WebServer and WebClient services. We can start these containers with one click through [docker-compose.yaml](./docker-compose.yaml).
|
||||||
|
|
||||||
|
- Modify docker-compose.yaml to map your data directory to the docker container of WebServer
|
||||||
|
```bash
|
||||||
|
$ wget https://raw.githubusercontent.com/milvus-io/bootcamp/master/solutions/image/reverse_image_search/docker-compose.yaml
|
||||||
|
$ vim docker-compose.yaml
|
||||||
|
```
|
||||||
|
**Then to change line 75:** `./data:/data` --> `your_data_path:/data`
|
||||||
|
|
||||||
|
- Create containers & start servers with docker-compose.yaml
|
||||||
|
```bash
|
||||||
|
$ docker-compose up -d
|
||||||
|
```
|
||||||
|
|
||||||
|
Then you will see the that all containers are created.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
Creating network "quick_deploy_app_net" with driver "bridge"
|
||||||
|
Creating milvus-etcd ... done
|
||||||
|
Creating milvus-minio ... done
|
||||||
|
Creating img-search-mysql ... done
|
||||||
|
Creating img-search-webclient ... done
|
||||||
|
Creating milvus-standalone ... done
|
||||||
|
Creating img-search-webserver ... done
|
||||||
|
```
|
||||||
|
|
||||||
|
And show all containers with `docker ps`, and you can use `docker logs img-search-webserver` to get the logs of **server** container.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
|
||||||
|
f24ddb15a529 milvusbootcamp/img-search-server:2.2.10 "/bin/sh -c 'python3…" 35 minutes ago Up 34 minutes 0.0.0.0:5000->5000/tcp, :::5000->5000/tcp img-search-webserver
|
||||||
|
d26b5cf21822 milvusdb/milvus:v2.2.10 "/tini -- milvus run…" 35 minutes ago Up 35 minutes 0.0.0.0:9091->9091/tcp, :::9091->9091/tcp, 0.0.0.0:19530->19530/tcp, :::19530->19530/tcp milvus-standalone
|
||||||
|
1e9254f56006 minio/minio:RELEASE.2023-03-20T20-16-18Z "/usr/bin/docker-ent…" 35 minutes ago Up 35 minutes (healthy) 9000/tcp milvus-minio
|
||||||
|
445cef3fe474 milvusbootcamp/img-search-client:2.2.10 "/docker-entrypoint.…" 35 minutes ago Up 35 minutes (unhealthy) 0.0.0.0:8001->80/tcp, :::8001->80/tcp img-search-webclient
|
||||||
|
d9bbab39f325 mysql:5.7 "docker-entrypoint.s…" 35 minutes ago Up 35 minutes 33060/tcp, 0.0.0.0:3306->3306/tcp, :::3306->3306/tcp img-search-mysql
|
||||||
|
807c2ace0b28 quay.io/coreos/etcd:v3.5.5 "etcd -advertise-cli…" 35 minutes ago Up 35 minutes 2379-2380/tcp milvus-etcd
|
||||||
|
```
|
||||||
|
|
||||||
|
## Option 2: Deploy with source code
|
||||||
|
|
||||||
|
We recommend using Docker Compose to deploy the reverse image search system. However, you also can run from source code, you need to manually start [Milvus](https://milvus.io) and [Mysql](https://dev.mysql.com/doc/mysql-installation-excerpt/5.7/en/docker-mysql-getting-started.html). Next show you how to run the API server and Client.
|
||||||
|
|
||||||
|
### 1. Start Milvus & Mysql
|
||||||
|
|
||||||
|
First, you need to start Milvus & Mysql servers.
|
||||||
|
|
||||||
|
Refer [Milvus Standalone](https://milvus.io/docs/install_standalone-docker.md) for how to install Milvus.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
$ wget https://github.com/milvus-io/milvus/releases/download/v2.2.10/milvus-standalone-docker-compose.yml -O docker-compose.yml
|
||||||
|
$ sudo docker-compose up -d
|
||||||
|
```
|
||||||
|
|
||||||
|
There are several ways to start Mysql. One option is using docker to create a container:
|
||||||
|
```bash
|
||||||
|
$ docker run -p 3306:3306 -e MYSQL_ROOT_PASSWORD=123456 -d --name image_search_mysql mysql:5.7
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
### 2. Start API Server
|
||||||
|
|
||||||
|
Then to start the system server, and it provides HTTP backend services.
|
||||||
|
|
||||||
|
- **Install the Python packages**
|
||||||
|
|
||||||
|
> Please note the Milvus version should [match pymilvus](https://milvus.io/docs/release_notes.md#Release-Notes) version in [requirements.txt](./server/requirements.txt). And this tutorial uses [milvus 2.2.10](https://milvus.io/docs/v2.2.x/install_standalone-docker.md) and [pymilvus 2.2.11](https://milvus.io/docs/release_notes.md#2210).
|
||||||
|
|
||||||
|
```bash
|
||||||
|
$ git clone https://github.com/milvus-io/bootcamp.git
|
||||||
|
$ cd bootcamp/solutions/image/reverse_image_search/server
|
||||||
|
$ pip install -r requirements.txt
|
||||||
|
```
|
||||||
|
|
||||||
|
- **Set configuration**
|
||||||
|
|
||||||
|
```bash
|
||||||
|
$ vim src/config.py
|
||||||
|
```
|
||||||
|
|
||||||
|
Modify the parameters according to your own environment. Here listing some parameters that need to be set, for more information please refer to [config.py](./server/src/config.py).
|
||||||
|
|
||||||
|
| **Parameter** | **Description** | **Default setting** |
|
||||||
|
| ---------------- | ----------------------------------------------------- | ------------------- |
|
||||||
|
| MILVUS_HOST | The IP address of Milvus, you can get it by ifconfig. | 127.0.0.1 |
|
||||||
|
| MILVUS_PORT | Port of Milvus. | 19530 |
|
||||||
|
| VECTOR_DIMENSION | Dimension of the vectors. | 1000 |
|
||||||
|
| MYSQL_HOST | The IP address of Mysql. | 127.0.0.1 |
|
||||||
|
| MYSQL_PORT | Port of Mysql. | 3306 |
|
||||||
|
| DEFAULT_TABLE | The milvus and mysql default collection name. | milvus_img_search |
|
||||||
|
|
||||||
|
- **Run the code**
|
||||||
|
|
||||||
|
Then start the server with Fastapi.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
$ python src/main.py
|
||||||
|
```
|
||||||
|
|
||||||
|
- **API Docs**
|
||||||
|
|
||||||
|
After starting the service, Please visit `127.0.0.1:5000/docs` in your browser to view all the APIs.
|
||||||
|
|
||||||
|
![fastapi](pic/fastapi.png)
|
||||||
|
|
||||||
|
> /data: get image by path
|
||||||
|
>
|
||||||
|
> /progress: get load progress
|
||||||
|
>
|
||||||
|
> /img/load: load images into milvus collection
|
||||||
|
>
|
||||||
|
> /img/count: count rows in milvus collection
|
||||||
|
>
|
||||||
|
> /img/drop: drop milvus collection & corresponding Mysql table
|
||||||
|
>
|
||||||
|
> /img/search: search for most similar image emb in milvus collection and get image info by milvus id in Mysql
|
||||||
|
|
||||||
|
### 3. Start Client
|
||||||
|
|
||||||
|
Next, start the frontend GUI.
|
||||||
|
|
||||||
|
- **Set parameters**
|
||||||
|
|
||||||
|
Modify the parameters according to your own environment.
|
||||||
|
|
||||||
|
| **Parameter** | **Description** | **example** |
|
||||||
|
| --------------- | ----------------------------------------------------- | ---------------- |
|
||||||
|
| **API_HOST** | The IP address of the backend server. | 127.0.0.1 |
|
||||||
|
| **API_PORT** | The port of the backend server. | 5000 |
|
||||||
|
|
||||||
|
```bash
|
||||||
|
$ export API_HOST='127.0.0.1'
|
||||||
|
$ export API_PORT='5000'
|
||||||
|
```
|
||||||
|
|
||||||
|
- **Run Docker**
|
||||||
|
|
||||||
|
First, build a container by pulling docker image.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
$ docker run -d \
|
||||||
|
-p 8001:80 \
|
||||||
|
-e "API_URL=http://${API_HOST}:${API_PORT}" \
|
||||||
|
milvusbootcamp/img-search-client:2.2.10
|
||||||
|
```
|
||||||
|
|
||||||
|
## How to use front-end
|
||||||
|
|
||||||
|
Navigate to `127.0.0.1:8001` in your browser to access the front-end interface.
|
||||||
|
|
||||||
|
### 1. Insert data
|
||||||
|
|
||||||
|
Enter `/data` in `path/to/your/images`, then click `+` to load the pictures. The following screenshot shows the loading process:
|
||||||
|
|
||||||
|
<img src="pic/web2.png" width = "650" height = "500" alt="arch" align=center />
|
||||||
|
|
||||||
|
> Notes:
|
||||||
|
>
|
||||||
|
> After clicking the Load (+) button, the first time load will take longer time since it needs time to download and prepare models. Please do not click again.
|
||||||
|
>
|
||||||
|
> You can check backend status for progress (check in terminal if using source code OR check docker logs of the server container if using docker)
|
||||||
|
|
||||||
|
The loading process may take several minutes. The following screenshot shows the interface with images loaded.
|
||||||
|
|
||||||
|
<img src="pic/web3.png" width = "650" height = "500" alt="arch" align=center />
|
||||||
|
|
||||||
|
### 2.Search for similar images
|
||||||
|
|
||||||
|
Select an image to search.
|
||||||
|
|
||||||
|
<img src="pic/web5.png" width = "650" height = "500" alt="arch" align=center />
|
||||||
|
|
||||||
|
## Code structure
|
||||||
|
|
||||||
|
If you are interested in our code or would like to contribute code, feel free to learn more about our code structure.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
Dockerfile
|
||||||
|
requirements.txt
|
||||||
|
src
|
||||||
|
├── __init__.py
|
||||||
|
├── config.py # Configuration file
|
||||||
|
├── encode.py # Convert an image to embedding using towhee pipeline (ResNet50)
|
||||||
|
├── logs.py
|
||||||
|
├── main.py # Source code to start webserver
|
||||||
|
├── milvus_helpers.py # Connect to Milvus server and insert/drop/query vectors in Milvus.
|
||||||
|
├── mysql_helpers.py # Connect to MySQL server, and add/delete/query IDs and object information.
|
||||||
|
├── operations
|
||||||
|
│ ├── __init__.py
|
||||||
|
│ ├── count.py
|
||||||
|
│ ├── drop.py
|
||||||
|
│ ├── load.py
|
||||||
|
│ ├── search.py
|
||||||
|
│ └── upload.py
|
||||||
|
└── test_main.py # Pytest file for main.py
|
||||||
|
```
|
|
@ -0,0 +1,3 @@
|
||||||
|
build
|
||||||
|
node_modules
|
||||||
|
yarn-error.log
|
|
@ -0,0 +1 @@
|
||||||
|
API_URL=http://192.168.1.85:5000
|
|
@ -0,0 +1,23 @@
|
||||||
|
# See https://help.github.com/articles/ignoring-files/ for more about ignoring files.
|
||||||
|
|
||||||
|
# dependencies
|
||||||
|
/node_modules
|
||||||
|
/.pnp
|
||||||
|
.pnp.js
|
||||||
|
|
||||||
|
# testing
|
||||||
|
/coverage
|
||||||
|
|
||||||
|
# production
|
||||||
|
/build
|
||||||
|
|
||||||
|
# misc
|
||||||
|
.DS_Store
|
||||||
|
.env.local
|
||||||
|
.env.development.local
|
||||||
|
.env.test.local
|
||||||
|
.env.production.local
|
||||||
|
yarn.lock
|
||||||
|
npm-debug.log*
|
||||||
|
yarn-debug.log*
|
||||||
|
yarn-error.log*
|
|
@ -0,0 +1,36 @@
|
||||||
|
# => Build container
|
||||||
|
FROM node:18-alpine as builder
|
||||||
|
ENV NODE_ENV=production
|
||||||
|
ENV NODE_OPTIONS="--openssl-legacy-provider"
|
||||||
|
WORKDIR /app
|
||||||
|
COPY package*.json ./
|
||||||
|
RUN npm install
|
||||||
|
COPY . .
|
||||||
|
RUN npm run build
|
||||||
|
|
||||||
|
# => Run container
|
||||||
|
FROM nginx:1.23.1-alpine
|
||||||
|
|
||||||
|
# Nginx config
|
||||||
|
RUN rm -rf /etc/nginx/conf.d
|
||||||
|
COPY conf /etc/nginx
|
||||||
|
|
||||||
|
# Static build
|
||||||
|
COPY --from=builder /app/build /usr/share/nginx/html/
|
||||||
|
|
||||||
|
# Default port exposure
|
||||||
|
EXPOSE 80
|
||||||
|
|
||||||
|
# Copy .env file and shell script to container
|
||||||
|
WORKDIR /usr/share/nginx/html
|
||||||
|
COPY ./env.sh .
|
||||||
|
COPY .env .
|
||||||
|
|
||||||
|
# Add bash
|
||||||
|
RUN apk add --no-cache bash
|
||||||
|
|
||||||
|
# Make our shell script executable
|
||||||
|
RUN chmod +x env.sh
|
||||||
|
|
||||||
|
# Start Nginx server
|
||||||
|
CMD ["/bin/bash", "-c", "/usr/share/nginx/html/env.sh && nginx -g \"daemon off;\""]
|
|
@ -0,0 +1,13 @@
|
||||||
|
server {
|
||||||
|
listen 80;
|
||||||
|
location / {
|
||||||
|
root /usr/share/nginx/html;
|
||||||
|
index index.html index.htm;
|
||||||
|
try_files $uri $uri/ /index.html;
|
||||||
|
expires -1; # Set it to different value depending on your standard requirements
|
||||||
|
}
|
||||||
|
error_page 500 502 503 504 /50x.html;
|
||||||
|
location = /50x.html {
|
||||||
|
root /usr/share/nginx/html;
|
||||||
|
}
|
||||||
|
}
|
|
@ -0,0 +1,24 @@
|
||||||
|
gzip on;
|
||||||
|
gzip_http_version 1.0;
|
||||||
|
gzip_comp_level 5; # 1-9
|
||||||
|
gzip_min_length 256;
|
||||||
|
gzip_proxied any;
|
||||||
|
gzip_vary on;
|
||||||
|
|
||||||
|
# MIME-types
|
||||||
|
gzip_types
|
||||||
|
application/atom+xml
|
||||||
|
application/javascript
|
||||||
|
application/json
|
||||||
|
application/rss+xml
|
||||||
|
application/vnd.ms-fontobject
|
||||||
|
application/x-font-ttf
|
||||||
|
application/x-web-app-manifest+json
|
||||||
|
application/xhtml+xml
|
||||||
|
application/xml
|
||||||
|
font/opentype
|
||||||
|
image/svg+xml
|
||||||
|
image/x-icon
|
||||||
|
text/css
|
||||||
|
text/plain
|
||||||
|
text/x-component;
|
|
@ -0,0 +1,3 @@
|
||||||
|
window._env_ = {
|
||||||
|
API_URL: "http://192.168.1.85:5000",
|
||||||
|
}
|
|
@ -0,0 +1,29 @@
|
||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
# Recreate config file
|
||||||
|
rm -rf ./env-config.js
|
||||||
|
touch ./env-config.js
|
||||||
|
|
||||||
|
# Add assignment
|
||||||
|
echo "window._env_ = {" >> ./env-config.js
|
||||||
|
|
||||||
|
# Read each line in .env file
|
||||||
|
# Each line represents key=value pairs
|
||||||
|
while read -r line || [[ -n "$line" ]];
|
||||||
|
do
|
||||||
|
# Split env variables by character `=`
|
||||||
|
if printf '%s\n' "$line" | grep -q -e '='; then
|
||||||
|
varname=$(printf '%s\n' "$line" | sed -e 's/=.*//')
|
||||||
|
varvalue=$(printf '%s\n' "$line" | sed -e 's/^[^=]*=//')
|
||||||
|
fi
|
||||||
|
|
||||||
|
# Read value of current variable if exists as Environment variable
|
||||||
|
value=$(printf '%s\n' "${!varname}")
|
||||||
|
# Otherwise use value from .env file
|
||||||
|
[[ -z $value ]] && value=${varvalue}
|
||||||
|
|
||||||
|
# Append configuration property to JS file
|
||||||
|
echo " $varname: \"$value\"," >> ./env-config.js
|
||||||
|
done < .env
|
||||||
|
|
||||||
|
echo "}" >> ./env-config.js
|
|
@ -0,0 +1,43 @@
|
||||||
|
{
|
||||||
|
"name": "milvus-search-demo-react",
|
||||||
|
"version": "0.1.0",
|
||||||
|
"private": true,
|
||||||
|
"resolutions": {
|
||||||
|
"@types/react": "16.9.0"
|
||||||
|
},
|
||||||
|
"dependencies": {
|
||||||
|
"@material-ui/core": "4.7.1",
|
||||||
|
"@material-ui/icons": "4.5.1",
|
||||||
|
"@types/node": "12.0.0",
|
||||||
|
"@types/react": "16.9.0",
|
||||||
|
"@types/react-dom": "16.9.0",
|
||||||
|
"axios": "^0.19.0",
|
||||||
|
"material-ui-dropzone": "2.4.7",
|
||||||
|
"react": "16.12.0",
|
||||||
|
"react-dom": "16.12.0",
|
||||||
|
"react-images": "1.0.0",
|
||||||
|
"react-photo-gallery": "8.0.0",
|
||||||
|
"react-scripts": "3.4.0",
|
||||||
|
"typescript": "3.7.2"
|
||||||
|
},
|
||||||
|
"scripts": {
|
||||||
|
"start": "react-scripts start",
|
||||||
|
"build": "react-scripts build",
|
||||||
|
"eject": "react-scripts eject"
|
||||||
|
},
|
||||||
|
"eslintConfig": {
|
||||||
|
"extends": "react-app"
|
||||||
|
},
|
||||||
|
"browserslist": {
|
||||||
|
"production": [
|
||||||
|
">0.2%",
|
||||||
|
"not dead",
|
||||||
|
"not op_mini all"
|
||||||
|
],
|
||||||
|
"development": [
|
||||||
|
"last 1 chrome version",
|
||||||
|
"last 1 firefox version",
|
||||||
|
"last 1 safari version"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
}
|
After Width: | Height: | Size: 3.8 KiB |
After Width: | Height: | Size: 2.9 KiB |
|
@ -0,0 +1,62 @@
|
||||||
|
<!DOCTYPE html>
|
||||||
|
<html lang="en">
|
||||||
|
<head>
|
||||||
|
<script src="%PUBLIC_URL%/env-config.js"></script>
|
||||||
|
<meta charset="utf-8" />
|
||||||
|
<link rel="icon" href="%PUBLIC_URL%/favicon.png" />
|
||||||
|
<meta name="viewport" content="width=device-width, initial-scale=1" />
|
||||||
|
<meta name="theme-color" content="#000000" />
|
||||||
|
<meta
|
||||||
|
name="description"
|
||||||
|
content="Web site created using create-react-app"
|
||||||
|
/>
|
||||||
|
<link rel="apple-touch-icon" href="%PUBLIC_URL%/logo192.png" />
|
||||||
|
<!--
|
||||||
|
manifest.json provides metadata used when your web app is installed on a
|
||||||
|
user's mobile device or desktop. See https://developers.google.com/web/fundamentals/web-app-manifest/
|
||||||
|
-->
|
||||||
|
<link rel="manifest" href="%PUBLIC_URL%/manifest.json" />
|
||||||
|
<!--
|
||||||
|
Notice the use of %PUBLIC_URL% in the tags above.
|
||||||
|
It will be replaced with the URL of the `public` folder during the build.
|
||||||
|
Only files inside the `public` folder can be referenced from the HTML.
|
||||||
|
|
||||||
|
Unlike "/favicon.ico" or "favicon.ico", "%PUBLIC_URL%/favicon.ico" will
|
||||||
|
work correctly both with client-side routing and a non-root public URL.
|
||||||
|
Learn how to configure a non-root public URL by running `npm run build`.
|
||||||
|
-->
|
||||||
|
<style>
|
||||||
|
html,
|
||||||
|
body,
|
||||||
|
#root {
|
||||||
|
margin: 0;
|
||||||
|
width: 100%;
|
||||||
|
height: 100%;
|
||||||
|
display: flex;
|
||||||
|
}
|
||||||
|
p,
|
||||||
|
h1,
|
||||||
|
h2,
|
||||||
|
h3,
|
||||||
|
h4,
|
||||||
|
h5 {
|
||||||
|
margin: 0;
|
||||||
|
}
|
||||||
|
</style>
|
||||||
|
<title>Milvus Demo</title>
|
||||||
|
</head>
|
||||||
|
<body>
|
||||||
|
<noscript>You need to enable JavaScript to run this app.</noscript>
|
||||||
|
<div id="root"></div>
|
||||||
|
<!--
|
||||||
|
This HTML file is a template.
|
||||||
|
If you open it directly in the browser, you will see an empty page.
|
||||||
|
|
||||||
|
You can add webfonts, meta tags, or analytics to this file.
|
||||||
|
The build step will place the bundled scripts into the <body> tag.
|
||||||
|
|
||||||
|
To begin the development, run `npm start` or `yarn start`.
|
||||||
|
To create a production bundle, use `npm run build` or `yarn build`.
|
||||||
|
-->
|
||||||
|
</body>
|
||||||
|
</html>
|
After Width: | Height: | Size: 5.2 KiB |
After Width: | Height: | Size: 9.4 KiB |
|
@ -0,0 +1,25 @@
|
||||||
|
{
|
||||||
|
"short_name": "React App",
|
||||||
|
"name": "Create React App Sample",
|
||||||
|
"icons": [
|
||||||
|
{
|
||||||
|
"src": "favicon.ico",
|
||||||
|
"sizes": "64x64 32x32 24x24 16x16",
|
||||||
|
"type": "image/x-icon"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"src": "logo192.png",
|
||||||
|
"type": "image/png",
|
||||||
|
"sizes": "192x192"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"src": "logo512.png",
|
||||||
|
"type": "image/png",
|
||||||
|
"sizes": "512x512"
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"start_url": ".",
|
||||||
|
"display": "standalone",
|
||||||
|
"theme_color": "#000000",
|
||||||
|
"background_color": "#ffffff"
|
||||||
|
}
|
|
@ -0,0 +1,2 @@
|
||||||
|
# https://www.robotstxt.org/robotstxt.html
|
||||||
|
User-agent: *
|
|
@ -0,0 +1,38 @@
|
||||||
|
.App {
|
||||||
|
text-align: center;
|
||||||
|
}
|
||||||
|
|
||||||
|
.App-logo {
|
||||||
|
height: 40vmin;
|
||||||
|
pointer-events: none;
|
||||||
|
}
|
||||||
|
|
||||||
|
@media (prefers-reduced-motion: no-preference) {
|
||||||
|
.App-logo {
|
||||||
|
animation: App-logo-spin infinite 20s linear;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
.App-header {
|
||||||
|
background-color: #282c34;
|
||||||
|
min-height: 100vh;
|
||||||
|
display: flex;
|
||||||
|
flex-direction: column;
|
||||||
|
align-items: center;
|
||||||
|
justify-content: center;
|
||||||
|
font-size: calc(10px + 2vmin);
|
||||||
|
color: white;
|
||||||
|
}
|
||||||
|
|
||||||
|
.App-link {
|
||||||
|
color: #61dafb;
|
||||||
|
}
|
||||||
|
|
||||||
|
@keyframes App-logo-spin {
|
||||||
|
from {
|
||||||
|
transform: rotate(0deg);
|
||||||
|
}
|
||||||
|
to {
|
||||||
|
transform: rotate(360deg);
|
||||||
|
}
|
||||||
|
}
|
|
@ -0,0 +1,45 @@
|
||||||
|
import React, { useState } from "react";
|
||||||
|
import { createStyles, makeStyles } from "@material-ui/core/styles";
|
||||||
|
import useMediaQuery from "@material-ui/core/useMediaQuery";
|
||||||
|
import QueryProvider from "./contexts/QueryContext";
|
||||||
|
import Setting from "./containers/Setting";
|
||||||
|
import SearchResults from "./components/SearchResults";
|
||||||
|
|
||||||
|
const App: React.FC = () => {
|
||||||
|
const isMobile = !useMediaQuery("(min-width:1000px)");
|
||||||
|
const useStyles = makeStyles(() => {
|
||||||
|
return createStyles({
|
||||||
|
root: {
|
||||||
|
flexGrow: 1,
|
||||||
|
display: isMobile ? "block" : "flex",
|
||||||
|
overflow: isMobile ? "visible" : "hidden",
|
||||||
|
},
|
||||||
|
});
|
||||||
|
});
|
||||||
|
const classes = useStyles({});
|
||||||
|
const [images, setImages]: any = useState([]);
|
||||||
|
const [loading, setLoading]: any = useState(false);
|
||||||
|
return (
|
||||||
|
<QueryProvider>
|
||||||
|
<div className={classes.root}>
|
||||||
|
<Setting setImages={setImages} setLoading={setLoading} />
|
||||||
|
<SearchResults images={images} />
|
||||||
|
{loading && (
|
||||||
|
<div
|
||||||
|
style={{
|
||||||
|
position: "absolute",
|
||||||
|
width: "100%",
|
||||||
|
height: "100%",
|
||||||
|
left: "0",
|
||||||
|
top: "0",
|
||||||
|
backgroundColor: "#000",
|
||||||
|
opacity: 0.5,
|
||||||
|
}}
|
||||||
|
></div>
|
||||||
|
)}
|
||||||
|
</div>
|
||||||
|
</QueryProvider>
|
||||||
|
);
|
||||||
|
};
|
||||||
|
|
||||||
|
export default App;
|
|
@ -0,0 +1,112 @@
|
||||||
|
import React, { useState } from "react";
|
||||||
|
import { createStyles, makeStyles } from "@material-ui/core/styles";
|
||||||
|
import { baseColor } from "../utils/color";
|
||||||
|
import useMediaQuery from "@material-ui/core/useMediaQuery";
|
||||||
|
|
||||||
|
const placeHolderImges = new Array(20).fill({});
|
||||||
|
const Gallary = (props: any) => {
|
||||||
|
const isMobile = !useMediaQuery("(min-width:1000px)");
|
||||||
|
const useStyles = makeStyles((theme) =>
|
||||||
|
createStyles({
|
||||||
|
root: {
|
||||||
|
display: isMobile ? "block:" : "flex",
|
||||||
|
justifyContent: "flex-start",
|
||||||
|
alignItems: "center",
|
||||||
|
flexWrap: "wrap",
|
||||||
|
},
|
||||||
|
title: {
|
||||||
|
marginTop: "20px",
|
||||||
|
fontSize: "20px",
|
||||||
|
},
|
||||||
|
imageContainer: {
|
||||||
|
position: "relative",
|
||||||
|
flex: isMobile ? 1 : "0 0 21%",
|
||||||
|
margin: isMobile ? 0 : "0 15px 15px 0",
|
||||||
|
paddingTop: isMobile ? "100%" : "20%",
|
||||||
|
border: "solid 1px #60606F",
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "center",
|
||||||
|
alignItems: "center",
|
||||||
|
fontSize: "50px",
|
||||||
|
width: isMobile ? "100%" : "auto",
|
||||||
|
height: isMobile ? "0" : "auto",
|
||||||
|
},
|
||||||
|
child: {
|
||||||
|
width: "100%",
|
||||||
|
maxHeight: "100%",
|
||||||
|
position: "absolute",
|
||||||
|
top: `0`,
|
||||||
|
bottom: `0`,
|
||||||
|
margin: "auto",
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "center",
|
||||||
|
alignItems: "center",
|
||||||
|
color: "#60606F",
|
||||||
|
fontSize: "8vw",
|
||||||
|
},
|
||||||
|
distant: {
|
||||||
|
fontSize: "1vw",
|
||||||
|
zIndex: 1000,
|
||||||
|
color: "#fafafa",
|
||||||
|
backgroundColor: "#000",
|
||||||
|
position: "absolute",
|
||||||
|
bottom: "0px",
|
||||||
|
left: "0px",
|
||||||
|
width: "100%",
|
||||||
|
height: "24px",
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "center",
|
||||||
|
alignItems: "center",
|
||||||
|
overflowX: "hidden",
|
||||||
|
textOverflow: "ellipsis",
|
||||||
|
whiteSpace: "nowrap",
|
||||||
|
},
|
||||||
|
})
|
||||||
|
);
|
||||||
|
const { images = [], onClick } = props;
|
||||||
|
const classes = useStyles({});
|
||||||
|
const [hovered, setHovered]: any = useState();
|
||||||
|
const onMouseOver = (e: any) => {
|
||||||
|
const src = e.currentTarget.dataset.src;
|
||||||
|
setHovered(src);
|
||||||
|
};
|
||||||
|
const onMouseLeave = () => {
|
||||||
|
setHovered(null);
|
||||||
|
};
|
||||||
|
return (
|
||||||
|
<div className={classes.root}>
|
||||||
|
{images.length > 0
|
||||||
|
? images.map((img: any, index: number) => {
|
||||||
|
const { src, distance } = img;
|
||||||
|
const isHovered = hovered === src;
|
||||||
|
return (
|
||||||
|
<div
|
||||||
|
className={classes.imageContainer}
|
||||||
|
onClick={() => {
|
||||||
|
onClick(index);
|
||||||
|
}}
|
||||||
|
onMouseOver={onMouseOver}
|
||||||
|
onMouseLeave={onMouseLeave}
|
||||||
|
key={src}
|
||||||
|
data-src={src}
|
||||||
|
style={{
|
||||||
|
border: `solid 2px ${isHovered ? baseColor : "transparent"}`,
|
||||||
|
}}
|
||||||
|
>
|
||||||
|
<img src={src} className={classes.child} alt="" />
|
||||||
|
{isHovered && (
|
||||||
|
<p className={classes.distant}>{distance.toFixed(6)}</p>
|
||||||
|
)}
|
||||||
|
</div>
|
||||||
|
);
|
||||||
|
})
|
||||||
|
: placeHolderImges.map((item: any, index: number) => (
|
||||||
|
<div className={classes.imageContainer} key={index}>
|
||||||
|
<p className={classes.child}>{index < 12 ? index + 1 : ""}</p>
|
||||||
|
</div>
|
||||||
|
))}
|
||||||
|
</div>
|
||||||
|
);
|
||||||
|
};
|
||||||
|
|
||||||
|
export default Gallary;
|
|
@ -0,0 +1,86 @@
|
||||||
|
import React, {useState, useCallback} from "react";
|
||||||
|
import {createStyles, makeStyles} from "@material-ui/core/styles";
|
||||||
|
import Carousel, {Modal, ModalGateway} from "react-images";
|
||||||
|
import Gallery from "./Gallary";
|
||||||
|
import {baseColor} from "../utils/color";
|
||||||
|
import {GetImageUrl} from "../utils/Endpoints";
|
||||||
|
|
||||||
|
|
||||||
|
const useStyles = makeStyles(theme =>
|
||||||
|
createStyles({
|
||||||
|
root: {
|
||||||
|
flexGrow: 1,
|
||||||
|
overflowX: "hidden",
|
||||||
|
overflowY: "auto",
|
||||||
|
padding: "80px 60px",
|
||||||
|
display: "flex",
|
||||||
|
flexDirection: "column",
|
||||||
|
backgroundColor: "#28292E"
|
||||||
|
},
|
||||||
|
title: {
|
||||||
|
margin: "20px 0px 10px",
|
||||||
|
fontSize: "20px",
|
||||||
|
color: "#F5F5F5"
|
||||||
|
},
|
||||||
|
subTitle: {
|
||||||
|
fontSize: "15px",
|
||||||
|
color: "#F1F1F1",
|
||||||
|
marginBottom: "10px !important"
|
||||||
|
}
|
||||||
|
})
|
||||||
|
);
|
||||||
|
|
||||||
|
const SearchResults = props => {
|
||||||
|
const classes = useStyles({});
|
||||||
|
const {images = []} = props;
|
||||||
|
const [currentImage, setCurrentImage] = useState(0);
|
||||||
|
const [viewerIsOpen, setViewerIsOpen] = useState(false);
|
||||||
|
const photos = images.map(img => {
|
||||||
|
return {
|
||||||
|
src: `${GetImageUrl}?image_path=${img[0]}`,
|
||||||
|
distance: img[1]
|
||||||
|
};
|
||||||
|
});
|
||||||
|
|
||||||
|
const openLightbox = useCallback(index => {
|
||||||
|
setCurrentImage(index);
|
||||||
|
setViewerIsOpen(true);
|
||||||
|
}, []);
|
||||||
|
|
||||||
|
const closeLightbox = () => {
|
||||||
|
setCurrentImage(0);
|
||||||
|
setViewerIsOpen(false);
|
||||||
|
};
|
||||||
|
|
||||||
|
return (
|
||||||
|
<div className={classes.root}>
|
||||||
|
<div className={classes.title}>
|
||||||
|
<h3 className={classes.title}>Search Results</h3>
|
||||||
|
{photos.length !== 0 && (
|
||||||
|
<p className={classes.subTitle}>
|
||||||
|
hover on the image to see{" "}
|
||||||
|
<span style={{color: baseColor}}>distance</span>(smaller value
|
||||||
|
represents higher simlarity); click to see the full image
|
||||||
|
</p>
|
||||||
|
)}
|
||||||
|
</div>
|
||||||
|
<Gallery images={photos} onClick={openLightbox}/>
|
||||||
|
<ModalGateway>
|
||||||
|
{viewerIsOpen ? (
|
||||||
|
<Modal onClose={closeLightbox}>
|
||||||
|
<Carousel
|
||||||
|
currentIndex={currentImage}
|
||||||
|
views={photos.map(x => ({
|
||||||
|
...x,
|
||||||
|
srcset: x.srcSet,
|
||||||
|
caption: x.title
|
||||||
|
}))}
|
||||||
|
/>
|
||||||
|
</Modal>
|
||||||
|
) : null}
|
||||||
|
</ModalGateway>
|
||||||
|
</div>
|
||||||
|
);
|
||||||
|
};
|
||||||
|
|
||||||
|
export default SearchResults;
|
|
@ -0,0 +1,38 @@
|
||||||
|
import React from "react";
|
||||||
|
|
||||||
|
const SeperatLine = (props: any) => {
|
||||||
|
const { title, style={} } = props;
|
||||||
|
return (
|
||||||
|
<div
|
||||||
|
style={{
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "space-between",
|
||||||
|
color: "rgba(176,176,185,0.75)",
|
||||||
|
marginBottom:"10px",
|
||||||
|
...style,
|
||||||
|
}}
|
||||||
|
>
|
||||||
|
<p style={{ marginRight: "20px"}}>{title}</p>
|
||||||
|
<div
|
||||||
|
style={{
|
||||||
|
flexGrow: 1,
|
||||||
|
textAlign: "center",
|
||||||
|
display: "flex",
|
||||||
|
alignItems: "center",
|
||||||
|
fontSize:'15px'
|
||||||
|
}}
|
||||||
|
>
|
||||||
|
<hr
|
||||||
|
style={{
|
||||||
|
width: "100%",
|
||||||
|
border: "none",
|
||||||
|
height: "1px",
|
||||||
|
backgroundColor: "rgba(176,176,185,0.75)"
|
||||||
|
}}
|
||||||
|
/>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
);
|
||||||
|
};
|
||||||
|
|
||||||
|
export default SeperatLine;
|
|
@ -0,0 +1 @@
|
||||||
|
<svg xmlns="http://www.w3.org/2000/svg" id="Layer_1" data-name="Layer 1" viewBox="0 0 905 400"><defs><style>.cls-2{fill:#33b6f2}</style></defs><path d="M358.87 169.11a16.81 16.81 0 011.56-6.91 11.41 11.41 0 013.61-4.35 14.34 14.34 0 015-2.22A25.61 25.61 0 01375 155a28.93 28.93 0 0110.85 1.81 23.08 23.08 0 015.91 3.12q5.92 12.16 12.41 25.88t13.23 26.54Q423.28 200.5 429 189t10.44-21.86q3.11-7 7.64-9.61A20.51 20.51 0 01457.3 155a31.52 31.52 0 0110.92 1.73 28.24 28.24 0 016 2.71l6.25 108.29h-27.61l-3.78-67.37-6.08 12.46q-3.12 6.41-6 12.65t-5.42 11.91q-2.55 5.67-4.52 10.11h-20.38q-1.8-4.44-4.51-10.35t-5.67-12.33q-3-6.41-6.08-12.73t-5.75-11.59l-3.62 67.21h-27.77zm146.93-7.73a14.44 14.44 0 014.2-10.51 14 14 0 0110.44-4.28 14.62 14.62 0 0114.79 14.79 14 14 0 01-4.28 10.44 14.44 14.44 0 01-10.52 4.18 14.32 14.32 0 01-14.63-14.63zm1.48 34.18q0-6.41 3.78-9t10-2.62a28.47 28.47 0 018 1.06c2.41.72 3.94 1.18 4.6 1.4v81.3h-26.38zm52.72-37.3q0-6.4 3.78-9t10-2.63a28.41 28.41 0 018 1.07c2.41.72 3.94 1.18 4.6 1.4v118.6H560zm77 109.44q-5.1-9-10-18.57t-8.79-17.83q-3.94-8.3-6.57-14.13t-3.29-7.48q-1.3-3.28-2.87-7.39a21.09 21.09 0 01-1.56-7.4 10.49 10.49 0 013.28-7.8q3.28-3.21 9.86-3.2a28.38 28.38 0 018.55 1.06 26.73 26.73 0 013.78 1.4q2.79 8.05 5.91 16.27t6 15.2q2.88 7 5.18 12.32c1.53 3.56 2.63 6.06 3.28 7.48q1-2.13 3.13-7.31t4.68-11.51q2.55-6.31 5.09-12.65T667 195.4a33.22 33.22 0 012.22-4.6 15 15 0 013-3.7 11.7 11.7 0 014.19-2.38 19.39 19.39 0 016.08-.82 24.9 24.9 0 015.92.65A32.43 32.43 0 01693 186a20.87 20.87 0 013.12 1.56c.77.5 1.26.8 1.48.91a62.35 62.35 0 01-3.12 8.95q-2.46 6-5.83 13.72t-7.32 16.19q-3.94 8.46-7.72 16.35t-7.07 14.21q-3.28 6.33-5.09 9.78zm103.37-39.11q0 17.1 15.45 17.09t15.44-17.09v-33q0-6.41 3.78-9t10-2.62a28.47 28.47 0 018 1.06c2.41.72 3.94 1.18 4.6 1.4v47.16a37.23 37.23 0 01-3.21 16 31.49 31.49 0 01-8.79 11.34 38 38 0 01-13.31 6.82 61 61 0 01-33.19 0 38 38 0 01-13.31-6.82 31.49 31.49 0 01-8.79-11.34 37.23 37.23 0 01-3.21-16v-38q0-6.41 3.78-9t10-2.62a28.43 28.43 0 018 1.06c2.41.72 3.94 1.18 4.6 1.4zm85.99 13.47a25.19 25.19 0 004.35 2.39 54.16 54.16 0 007.23 2.63 83.38 83.38 0 009.53 2.13 66.7 66.7 0 0011.26.91q6.74 0 10.19-1.24t3.45-4.35a4.51 4.51 0 00-2.88-4.52 37 37 0 00-9-2L852 237a96.61 96.61 0 01-12.32-2.38 34 34 0 01-10.43-4.6 22.13 22.13 0 01-7.15-7.81 24.49 24.49 0 01-2.63-12 28.28 28.28 0 012.22-11.26 23.5 23.5 0 017-9 35.26 35.26 0 0112.16-6.08 61.53 61.53 0 0117.58-2.22 104.09 104.09 0 0117.83 1.32 45.28 45.28 0 0112.9 4.11 15.51 15.51 0 015 4 9.12 9.12 0 011.89 5.84 9.9 9.9 0 01-1.07 4.68 16 16 0 01-5.09 5.83q-1.23.83-1.56 1a17.91 17.91 0 00-2.71-1.81 32.06 32.06 0 00-5.92-2.55 68.58 68.58 0 00-8.87-2.21 62.94 62.94 0 00-11.75-1q-7.39 0-10.27 1.73a5.13 5.13 0 00-2.88 4.51 4 4 0 002.63 3.95 33.78 33.78 0 007.89 2l15 2.14a75.35 75.35 0 0110.77 2.38 30.15 30.15 0 019.2 4.52 21.51 21.51 0 016.41 7.56 24.16 24.16 0 012.38 11.17q0 13.8-10.52 21.53T860.54 270a98.22 98.22 0 01-30.07-4.35 47.69 47.69 0 01-8.79-3.62 47.15 47.15 0 01-4.69-2.88z" fill="#fff"/><path class="cls-2" d="M212.05 135.73c-39.78-39-104.28-39.06-144.07 0L2.88 199.6a9.55 9.55 0 000 13.67l65.06 63.91c39.78 39.07 104.3 39.09 144.11 0a98.75 98.75 0 000-141.48zm-15.43 122.71a75.84 75.84 0 01-105.86 0l-47.8-47a7 7 0 010-10l47.82-46.93a75.86 75.86 0 01105.85 0 72.54 72.54 0 01-.01 103.93zm100.64-58.77L268.64 171a2.41 2.41 0 00-4.07 2.21 150.35 150.35 0 010 66.51 2.41 2.41 0 004.07 2.21l28.64-28.63a9.66 9.66 0 00-.02-13.63z"/><circle class="cls-2" cx="144.04" cy="206.49" r="50.14"/></svg>
|
After Width: | Height: | Size: 3.4 KiB |
|
@ -0,0 +1,384 @@
|
||||||
|
import React, { useState, useEffect, useContext, useRef } from "react";
|
||||||
|
import { queryContext } from "../contexts/QueryContext";
|
||||||
|
import { createStyles, Theme, makeStyles } from "@material-ui/core/styles";
|
||||||
|
import useMediaQuery from "@material-ui/core/useMediaQuery";
|
||||||
|
import TextField from "@material-ui/core/TextField";
|
||||||
|
import Fab from "@material-ui/core/Fab";
|
||||||
|
import AddIcon from "@material-ui/icons/Add";
|
||||||
|
import CloseIcon from "@material-ui/icons/Close";
|
||||||
|
import Slider from "@material-ui/core/Slider";
|
||||||
|
import { DropzoneArea } from "material-ui-dropzone";
|
||||||
|
import SeperatLine from "../components/SeperatLine";
|
||||||
|
import { baseColor } from "../utils/color";
|
||||||
|
import Logo from "./Logo.svg";
|
||||||
|
import { delayRunFunc } from "../utils/Helper";
|
||||||
|
|
||||||
|
const Setting = (props: any) => {
|
||||||
|
const isMobile = !useMediaQuery("(min-width:1000px)");
|
||||||
|
const useStyles = makeStyles((theme: Theme) => {
|
||||||
|
return createStyles({
|
||||||
|
setting: {
|
||||||
|
display: "flex",
|
||||||
|
flexDirection: "column",
|
||||||
|
minWidth: isMobile ? "90%" : "300px",
|
||||||
|
padding: "60px 20px",
|
||||||
|
borderWidth: "1px",
|
||||||
|
backgroundColor: "#1F2023",
|
||||||
|
color: "#E4E4E6",
|
||||||
|
overflowY: "auto",
|
||||||
|
},
|
||||||
|
header: {
|
||||||
|
marginBottom: "30px",
|
||||||
|
display: "flex",
|
||||||
|
flexDirection: "column",
|
||||||
|
alignItems: "center",
|
||||||
|
},
|
||||||
|
configHead: {
|
||||||
|
marginBottom: "30px",
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "space-between",
|
||||||
|
alignItems: "center",
|
||||||
|
},
|
||||||
|
config: {
|
||||||
|
fontSize: "24px",
|
||||||
|
color: "#FAFAFA",
|
||||||
|
},
|
||||||
|
clear: {
|
||||||
|
color: baseColor,
|
||||||
|
fontSize: "18px",
|
||||||
|
cursor: "pointer",
|
||||||
|
},
|
||||||
|
imageSet: {},
|
||||||
|
counts: {
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "space-between",
|
||||||
|
alignItems: "center",
|
||||||
|
marginBottom: "30px",
|
||||||
|
color: "#FAFAFA",
|
||||||
|
},
|
||||||
|
currTotal: {
|
||||||
|
fontSize: "12px",
|
||||||
|
},
|
||||||
|
setPath: {
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "start",
|
||||||
|
alignItems: "center",
|
||||||
|
marginBottom: "30px",
|
||||||
|
},
|
||||||
|
customInput: {
|
||||||
|
margin: "0 20px 0 0 !important",
|
||||||
|
color: "blue !important",
|
||||||
|
width: isMobile ? "80%" : "auto",
|
||||||
|
},
|
||||||
|
customFab: {
|
||||||
|
color: "#fff",
|
||||||
|
backgroundColor: baseColor,
|
||||||
|
width: "36px",
|
||||||
|
height: "36px",
|
||||||
|
"&:hover": {
|
||||||
|
backgroundColor: baseColor,
|
||||||
|
},
|
||||||
|
},
|
||||||
|
customDeleteFab: {
|
||||||
|
position: "absolute",
|
||||||
|
top: "5px",
|
||||||
|
right: "5px",
|
||||||
|
color: "#fff",
|
||||||
|
backgroundColor: "#666769",
|
||||||
|
width: "24px",
|
||||||
|
height: "24px",
|
||||||
|
minHeight: "0px",
|
||||||
|
"&:hover": {
|
||||||
|
backgroundColor: "#666769",
|
||||||
|
},
|
||||||
|
},
|
||||||
|
customDelete: {
|
||||||
|
color: "#A7A7AF",
|
||||||
|
width: "18px",
|
||||||
|
height: "18px",
|
||||||
|
},
|
||||||
|
customIcon: {
|
||||||
|
color: "#fff",
|
||||||
|
backgroundColor: baseColor,
|
||||||
|
width: "20px",
|
||||||
|
height: "20px",
|
||||||
|
},
|
||||||
|
customSlider: {
|
||||||
|
color: baseColor,
|
||||||
|
marginBottom: "30px",
|
||||||
|
},
|
||||||
|
thumb: {
|
||||||
|
width: "16px",
|
||||||
|
height: "16px",
|
||||||
|
},
|
||||||
|
track: {
|
||||||
|
height: "4px",
|
||||||
|
borderRadius: "10px",
|
||||||
|
},
|
||||||
|
upload: {
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "center",
|
||||||
|
alignItems: "center",
|
||||||
|
},
|
||||||
|
benchImage: {
|
||||||
|
width: "400px",
|
||||||
|
height: "250px",
|
||||||
|
position: "relative",
|
||||||
|
},
|
||||||
|
dropzoneContainer: {
|
||||||
|
backgroundColor: "transparent",
|
||||||
|
width: "250px",
|
||||||
|
height: "250px",
|
||||||
|
borderRadius: "10px",
|
||||||
|
border: "solid .5px #C8C8C8",
|
||||||
|
display: "flex",
|
||||||
|
justifyContent: "center",
|
||||||
|
alignItems: "center",
|
||||||
|
},
|
||||||
|
dropzoneText: {
|
||||||
|
fontSize: "14px",
|
||||||
|
color: "#B3B4B5",
|
||||||
|
marginBottom: "30px",
|
||||||
|
},
|
||||||
|
notchedOutline: {
|
||||||
|
borderWidth: ".5px",
|
||||||
|
borderColor: "#838385 !important",
|
||||||
|
},
|
||||||
|
formLabel: {
|
||||||
|
color: "#fff",
|
||||||
|
},
|
||||||
|
controlLabel: {
|
||||||
|
color: "#838385",
|
||||||
|
},
|
||||||
|
});
|
||||||
|
});
|
||||||
|
const { process, train, count, search, clearAll } = useContext(queryContext);
|
||||||
|
const { setImages, loading, setLoading } = props;
|
||||||
|
const classes = useStyles({});
|
||||||
|
const [inputs, setInputs]: any = useState("");
|
||||||
|
const [topK, setTopK]: any = useState(5);
|
||||||
|
const [totalNum, setTotalNum]: any = useState(0);
|
||||||
|
const [[current, total], setProcessedNum]: any = useState([0, 0]);
|
||||||
|
const [image, setImage]: any = useState();
|
||||||
|
|
||||||
|
const benchImage = useRef<any>(null);
|
||||||
|
const setText = loading
|
||||||
|
? "Loading..."
|
||||||
|
: totalNum
|
||||||
|
? `${totalNum} images in this set`
|
||||||
|
: "No image in this set";
|
||||||
|
|
||||||
|
const reader = new FileReader();
|
||||||
|
reader.addEventListener(
|
||||||
|
"load",
|
||||||
|
function () {
|
||||||
|
if (benchImage.current) {
|
||||||
|
benchImage.current.src = reader.result;
|
||||||
|
}
|
||||||
|
},
|
||||||
|
false
|
||||||
|
);
|
||||||
|
const _search = ({ topK, image }: any) => {
|
||||||
|
const fd = new FormData();
|
||||||
|
fd.set("topk", topK);
|
||||||
|
fd.append("image", image);
|
||||||
|
search(fd).then((res: any) => {
|
||||||
|
const { status, data } = res || {};
|
||||||
|
if (status === 200) {
|
||||||
|
setImages(data);
|
||||||
|
}
|
||||||
|
});
|
||||||
|
};
|
||||||
|
|
||||||
|
const uploadImg = (file: any) => {
|
||||||
|
setImage(file);
|
||||||
|
reader.readAsDataURL(file);
|
||||||
|
_search({ topK, image: file });
|
||||||
|
};
|
||||||
|
|
||||||
|
const onInputChange = (e: any) => {
|
||||||
|
const val = e.target.value;
|
||||||
|
setInputs(val);
|
||||||
|
};
|
||||||
|
|
||||||
|
const onTopKChange = (e: any, val: any) => {
|
||||||
|
setTopK(val);
|
||||||
|
if (val && image) {
|
||||||
|
delayRunFunc({ topK: val, image }, _search, 300);
|
||||||
|
}
|
||||||
|
};
|
||||||
|
const _keepProcess = () => {
|
||||||
|
process().then((res: any) => {
|
||||||
|
const { data, status } = res;
|
||||||
|
if (status === 200) {
|
||||||
|
const [_current, _total] = data
|
||||||
|
.split(",")
|
||||||
|
.map((item: any) => Number.parseInt(item.split(":")[1]));
|
||||||
|
setProcessedNum([_current, _total]);
|
||||||
|
if (_current !== _total) {
|
||||||
|
setTimeout(() => _keepProcess(), 1000);
|
||||||
|
} else {
|
||||||
|
setTimeout(() => {
|
||||||
|
count().then((res: any) => {
|
||||||
|
const { data, status } = res;
|
||||||
|
if (status === 200) {
|
||||||
|
setTotalNum(data);
|
||||||
|
setLoading(false);
|
||||||
|
}
|
||||||
|
});
|
||||||
|
}, 3000);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
});
|
||||||
|
};
|
||||||
|
const uploadImgPath = () => {
|
||||||
|
train({ File: inputs }).then((res: any) => {
|
||||||
|
if (res.status === 200) {
|
||||||
|
setLoading(true);
|
||||||
|
setTimeout(() => {
|
||||||
|
setInputs("");
|
||||||
|
_keepProcess();
|
||||||
|
}, 1000);
|
||||||
|
}
|
||||||
|
});
|
||||||
|
};
|
||||||
|
|
||||||
|
const clear = () => {
|
||||||
|
clearAll().then((res: any) => {
|
||||||
|
if (res.status === 200) {
|
||||||
|
setProcessedNum([0, 0]);
|
||||||
|
setTotalNum(0);
|
||||||
|
setImage();
|
||||||
|
setImages([]);
|
||||||
|
}
|
||||||
|
});
|
||||||
|
};
|
||||||
|
|
||||||
|
useEffect(() => {
|
||||||
|
count().then((res: any) => {
|
||||||
|
const { data, status } = res || {};
|
||||||
|
if (status === 200) {
|
||||||
|
setTotalNum(data);
|
||||||
|
}
|
||||||
|
});
|
||||||
|
// eslint-disable-next-line react-hooks/exhaustive-deps
|
||||||
|
}, []);
|
||||||
|
|
||||||
|
return (
|
||||||
|
<div className={classes.setting}>
|
||||||
|
<div className={classes.header}>
|
||||||
|
<img src={Logo} width="150px" alt="logo" />
|
||||||
|
<p>Image Search Demo</p>
|
||||||
|
</div>
|
||||||
|
<div className={classes.configHead}>
|
||||||
|
<h4 className={classes.config}>Config</h4>
|
||||||
|
<h4 className={classes.clear} onClick={clear}>
|
||||||
|
CLEAR ALL
|
||||||
|
</h4>
|
||||||
|
</div>
|
||||||
|
<SeperatLine title={`IMAGE SET`} style={{ marginBottom: "20px" }} />
|
||||||
|
<div className={classes.imageSet}>
|
||||||
|
<div className={classes.counts}>
|
||||||
|
<p style={{ color: loading ? baseColor : "#fff" }}>{setText}</p>
|
||||||
|
<h3 className={classes.currTotal}>{`${current}/${total}`}</h3>
|
||||||
|
</div>
|
||||||
|
<div className={classes.setPath}>
|
||||||
|
<TextField
|
||||||
|
classes={{ root: classes.customInput }}
|
||||||
|
label=""
|
||||||
|
variant="outlined"
|
||||||
|
value={inputs}
|
||||||
|
onChange={onInputChange}
|
||||||
|
InputLabelProps={{
|
||||||
|
shrink: true,
|
||||||
|
classes: {
|
||||||
|
root: classes.controlLabel,
|
||||||
|
focused: classes.controlLabel,
|
||||||
|
},
|
||||||
|
}}
|
||||||
|
margin="normal"
|
||||||
|
InputProps={{
|
||||||
|
style: {
|
||||||
|
textAlign: "left",
|
||||||
|
width: isMobile ? "100%" : "340px",
|
||||||
|
height: "40px",
|
||||||
|
},
|
||||||
|
classes: {
|
||||||
|
notchedOutline: classes.notchedOutline,
|
||||||
|
root: classes.formLabel,
|
||||||
|
},
|
||||||
|
placeholder: "path/to/your/images",
|
||||||
|
}}
|
||||||
|
/>
|
||||||
|
<Fab
|
||||||
|
classes={{
|
||||||
|
root: classes.customFab,
|
||||||
|
focusVisible: classes.customFab,
|
||||||
|
}}
|
||||||
|
>
|
||||||
|
<AddIcon
|
||||||
|
onClick={uploadImgPath}
|
||||||
|
classes={{ root: classes.customIcon }}
|
||||||
|
/>
|
||||||
|
</Fab>
|
||||||
|
</div>
|
||||||
|
<SeperatLine title={`TOP K(1-100)`} style={{ marginBottom: "20px" }} />
|
||||||
|
<div className={classes.counts}>
|
||||||
|
<p>{`show top ${topK} results`}</p>
|
||||||
|
</div>
|
||||||
|
<Slider
|
||||||
|
min={1}
|
||||||
|
max={100}
|
||||||
|
value={topK}
|
||||||
|
onChange={onTopKChange}
|
||||||
|
classes={{
|
||||||
|
root: classes.customSlider,
|
||||||
|
track: classes.track,
|
||||||
|
rail: classes.track,
|
||||||
|
thumb: classes.thumb,
|
||||||
|
}}
|
||||||
|
/>
|
||||||
|
</div>
|
||||||
|
<SeperatLine title={`ORIGINAL IMAGE`} style={{ marginBottom: "50px" }} />
|
||||||
|
<div className={classes.upload}>
|
||||||
|
{image ? (
|
||||||
|
<div className={classes.benchImage}>
|
||||||
|
<img
|
||||||
|
ref={benchImage}
|
||||||
|
className={classes.benchImage}
|
||||||
|
src={image}
|
||||||
|
alt="..."
|
||||||
|
/>
|
||||||
|
<Fab
|
||||||
|
color="primary"
|
||||||
|
aria-label="add"
|
||||||
|
size="small"
|
||||||
|
classes={{ root: classes.customDeleteFab }}
|
||||||
|
>
|
||||||
|
<CloseIcon
|
||||||
|
onClick={() => {
|
||||||
|
setImage();
|
||||||
|
setImages([]);
|
||||||
|
}}
|
||||||
|
classes={{ root: classes.customDelete }}
|
||||||
|
/>
|
||||||
|
</Fab>
|
||||||
|
</div>
|
||||||
|
) : (
|
||||||
|
<DropzoneArea
|
||||||
|
acceptedFiles={["image/*"]}
|
||||||
|
filesLimit={1}
|
||||||
|
dropzoneText={`click to upload / drag a image here`}
|
||||||
|
onDrop={uploadImg}
|
||||||
|
dropzoneClass={classes.dropzoneContainer}
|
||||||
|
showPreviewsInDropzone={false}
|
||||||
|
dropzoneParagraphClass={classes.dropzoneText}
|
||||||
|
// maxFileSize={} bit
|
||||||
|
/>
|
||||||
|
)}
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
);
|
||||||
|
};
|
||||||
|
|
||||||
|
export default Setting;
|
|
@ -0,0 +1,51 @@
|
||||||
|
import React, { FC, createContext, ReactNode } from "react";
|
||||||
|
import axios from "axios";
|
||||||
|
import * as URL from "../utils/Endpoints";
|
||||||
|
|
||||||
|
const axiosInstance = axios.create();
|
||||||
|
|
||||||
|
export const queryContext = createContext<any>({});
|
||||||
|
const Provider = queryContext.Provider;
|
||||||
|
|
||||||
|
const QueryProvider: FC<{ children: ReactNode }> = ({ children }) => {
|
||||||
|
const errorParser = (e: any) => {
|
||||||
|
console.log(e);
|
||||||
|
};
|
||||||
|
const process = async (params: any) => {
|
||||||
|
const url = URL.Processing;
|
||||||
|
return await axiosInstance.get(url, params).catch(errorParser);
|
||||||
|
};
|
||||||
|
const count = async (params: any) => {
|
||||||
|
const url = URL.Count;
|
||||||
|
return await axiosInstance.post(url, params).catch(errorParser);
|
||||||
|
};
|
||||||
|
const train = async (params: any) => {
|
||||||
|
const url = URL.Train;
|
||||||
|
return await axiosInstance.post(url, params).catch(errorParser);
|
||||||
|
};
|
||||||
|
|
||||||
|
const search = async (params: any) => {
|
||||||
|
const url = URL.Search;
|
||||||
|
return await axiosInstance.post(url, params).catch(errorParser);
|
||||||
|
};
|
||||||
|
const clearAll = async () => {
|
||||||
|
const url = URL.ClearAll;
|
||||||
|
return await axiosInstance.post(url).catch(errorParser);
|
||||||
|
};
|
||||||
|
|
||||||
|
return (
|
||||||
|
<Provider
|
||||||
|
value={{
|
||||||
|
process,
|
||||||
|
count,
|
||||||
|
search,
|
||||||
|
clearAll,
|
||||||
|
train
|
||||||
|
}}
|
||||||
|
>
|
||||||
|
{children}
|
||||||
|
</Provider>
|
||||||
|
);
|
||||||
|
};
|
||||||
|
|
||||||
|
export default QueryProvider;
|
|
@ -0,0 +1,13 @@
|
||||||
|
body {
|
||||||
|
margin: 0;
|
||||||
|
font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', 'Roboto', 'Oxygen',
|
||||||
|
'Ubuntu', 'Cantarell', 'Fira Sans', 'Droid Sans', 'Helvetica Neue',
|
||||||
|
sans-serif;
|
||||||
|
-webkit-font-smoothing: antialiased;
|
||||||
|
-moz-osx-font-smoothing: grayscale;
|
||||||
|
}
|
||||||
|
|
||||||
|
code {
|
||||||
|
font-family: source-code-pro, Menlo, Monaco, Consolas, 'Courier New',
|
||||||
|
monospace;
|
||||||
|
}
|
|
@ -0,0 +1,12 @@
|
||||||
|
import React from 'react';
|
||||||
|
import ReactDOM from 'react-dom';
|
||||||
|
import './index.css';
|
||||||
|
import App from './App';
|
||||||
|
import * as serviceWorker from './serviceWorker';
|
||||||
|
|
||||||
|
ReactDOM.render(<App />, document.getElementById('root'));
|
||||||
|
|
||||||
|
// If you want your app to work offline and load faster, you can change
|
||||||
|
// unregister() to register() below. Note this comes with some pitfalls.
|
||||||
|
// Learn more about service workers: https://bit.ly/CRA-PWA
|
||||||
|
serviceWorker.unregister();
|
|
@ -0,0 +1,7 @@
|
||||||
|
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 841.9 595.3">
|
||||||
|
<g fill="#61DAFB">
|
||||||
|
<path d="M666.3 296.5c0-32.5-40.7-63.3-103.1-82.4 14.4-63.6 8-114.2-20.2-130.4-6.5-3.8-14.1-5.6-22.4-5.6v22.3c4.6 0 8.3.9 11.4 2.6 13.6 7.8 19.5 37.5 14.9 75.7-1.1 9.4-2.9 19.3-5.1 29.4-19.6-4.8-41-8.5-63.5-10.9-13.5-18.5-27.5-35.3-41.6-50 32.6-30.3 63.2-46.9 84-46.9V78c-27.5 0-63.5 19.6-99.9 53.6-36.4-33.8-72.4-53.2-99.9-53.2v22.3c20.7 0 51.4 16.5 84 46.6-14 14.7-28 31.4-41.3 49.9-22.6 2.4-44 6.1-63.6 11-2.3-10-4-19.7-5.2-29-4.7-38.2 1.1-67.9 14.6-75.8 3-1.8 6.9-2.6 11.5-2.6V78.5c-8.4 0-16 1.8-22.6 5.6-28.1 16.2-34.4 66.7-19.9 130.1-62.2 19.2-102.7 49.9-102.7 82.3 0 32.5 40.7 63.3 103.1 82.4-14.4 63.6-8 114.2 20.2 130.4 6.5 3.8 14.1 5.6 22.5 5.6 27.5 0 63.5-19.6 99.9-53.6 36.4 33.8 72.4 53.2 99.9 53.2 8.4 0 16-1.8 22.6-5.6 28.1-16.2 34.4-66.7 19.9-130.1 62-19.1 102.5-49.9 102.5-82.3zm-130.2-66.7c-3.7 12.9-8.3 26.2-13.5 39.5-4.1-8-8.4-16-13.1-24-4.6-8-9.5-15.8-14.4-23.4 14.2 2.1 27.9 4.7 41 7.9zm-45.8 106.5c-7.8 13.5-15.8 26.3-24.1 38.2-14.9 1.3-30 2-45.2 2-15.1 0-30.2-.7-45-1.9-8.3-11.9-16.4-24.6-24.2-38-7.6-13.1-14.5-26.4-20.8-39.8 6.2-13.4 13.2-26.8 20.7-39.9 7.8-13.5 15.8-26.3 24.1-38.2 14.9-1.3 30-2 45.2-2 15.1 0 30.2.7 45 1.9 8.3 11.9 16.4 24.6 24.2 38 7.6 13.1 14.5 26.4 20.8 39.8-6.3 13.4-13.2 26.8-20.7 39.9zm32.3-13c5.4 13.4 10 26.8 13.8 39.8-13.1 3.2-26.9 5.9-41.2 8 4.9-7.7 9.8-15.6 14.4-23.7 4.6-8 8.9-16.1 13-24.1zM421.2 430c-9.3-9.6-18.6-20.3-27.8-32 9 .4 18.2.7 27.5.7 9.4 0 18.7-.2 27.8-.7-9 11.7-18.3 22.4-27.5 32zm-74.4-58.9c-14.2-2.1-27.9-4.7-41-7.9 3.7-12.9 8.3-26.2 13.5-39.5 4.1 8 8.4 16 13.1 24 4.7 8 9.5 15.8 14.4 23.4zM420.7 163c9.3 9.6 18.6 20.3 27.8 32-9-.4-18.2-.7-27.5-.7-9.4 0-18.7.2-27.8.7 9-11.7 18.3-22.4 27.5-32zm-74 58.9c-4.9 7.7-9.8 15.6-14.4 23.7-4.6 8-8.9 16-13 24-5.4-13.4-10-26.8-13.8-39.8 13.1-3.1 26.9-5.8 41.2-7.9zm-90.5 125.2c-35.4-15.1-58.3-34.9-58.3-50.6 0-15.7 22.9-35.6 58.3-50.6 8.6-3.7 18-7 27.7-10.1 5.7 19.6 13.2 40 22.5 60.9-9.2 20.8-16.6 41.1-22.2 60.6-9.9-3.1-19.3-6.5-28-10.2zM310 490c-13.6-7.8-19.5-37.5-14.9-75.7 1.1-9.4 2.9-19.3 5.1-29.4 19.6 4.8 41 8.5 63.5 10.9 13.5 18.5 27.5 35.3 41.6 50-32.6 30.3-63.2 46.9-84 46.9-4.5-.1-8.3-1-11.3-2.7zm237.2-76.2c4.7 38.2-1.1 67.9-14.6 75.8-3 1.8-6.9 2.6-11.5 2.6-20.7 0-51.4-16.5-84-46.6 14-14.7 28-31.4 41.3-49.9 22.6-2.4 44-6.1 63.6-11 2.3 10.1 4.1 19.8 5.2 29.1zm38.5-66.7c-8.6 3.7-18 7-27.7 10.1-5.7-19.6-13.2-40-22.5-60.9 9.2-20.8 16.6-41.1 22.2-60.6 9.9 3.1 19.3 6.5 28.1 10.2 35.4 15.1 58.3 34.9 58.3 50.6-.1 15.7-23 35.6-58.4 50.6zM320.8 78.4z"/>
|
||||||
|
<circle cx="420.9" cy="296.5" r="45.7"/>
|
||||||
|
<path d="M520.5 78.1z"/>
|
||||||
|
</g>
|
||||||
|
</svg>
|
After Width: | Height: | Size: 2.6 KiB |
|
@ -0,0 +1 @@
|
||||||
|
/// <reference types="react-scripts" />
|
|
@ -0,0 +1,145 @@
|
||||||
|
// This optional code is used to register a service worker.
|
||||||
|
// register() is not called by default.
|
||||||
|
|
||||||
|
// This lets the app load faster on subsequent visits in production, and gives
|
||||||
|
// it offline capabilities. However, it also means that developers (and users)
|
||||||
|
// will only see deployed updates on subsequent visits to a page, after all the
|
||||||
|
// existing tabs open on the page have been closed, since previously cached
|
||||||
|
// resources are updated in the background.
|
||||||
|
|
||||||
|
// To learn more about the benefits of this model and instructions on how to
|
||||||
|
// opt-in, read https://bit.ly/CRA-PWA
|
||||||
|
|
||||||
|
const isLocalhost = Boolean(
|
||||||
|
window.location.hostname === 'localhost' ||
|
||||||
|
// [::1] is the IPv6 localhost address.
|
||||||
|
window.location.hostname === '[::1]' ||
|
||||||
|
// 127.0.0.0/8 are considered localhost for IPv4.
|
||||||
|
window.location.hostname.match(
|
||||||
|
/^127(?:\.(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)){3}$/
|
||||||
|
)
|
||||||
|
);
|
||||||
|
|
||||||
|
type Config = {
|
||||||
|
onSuccess?: (registration: ServiceWorkerRegistration) => void;
|
||||||
|
onUpdate?: (registration: ServiceWorkerRegistration) => void;
|
||||||
|
};
|
||||||
|
|
||||||
|
export function register(config?: Config) {
|
||||||
|
if (process.env.NODE_ENV === 'production' && 'serviceWorker' in navigator) {
|
||||||
|
// The URL constructor is available in all browsers that support SW.
|
||||||
|
const publicUrl = new URL(
|
||||||
|
process.env.PUBLIC_URL,
|
||||||
|
window.location.href
|
||||||
|
);
|
||||||
|
if (publicUrl.origin !== window.location.origin) {
|
||||||
|
// Our service worker won't work if PUBLIC_URL is on a different origin
|
||||||
|
// from what our page is served on. This might happen if a CDN is used to
|
||||||
|
// serve assets; see https://github.com/facebook/create-react-app/issues/2374
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
|
||||||
|
window.addEventListener('load', () => {
|
||||||
|
const swUrl = `${process.env.PUBLIC_URL}/service-worker.js`;
|
||||||
|
|
||||||
|
if (isLocalhost) {
|
||||||
|
// This is running on localhost. Let's check if a service worker still exists or not.
|
||||||
|
checkValidServiceWorker(swUrl, config);
|
||||||
|
|
||||||
|
// Add some additional logging to localhost, pointing developers to the
|
||||||
|
// service worker/PWA documentation.
|
||||||
|
navigator.serviceWorker.ready.then(() => {
|
||||||
|
console.log(
|
||||||
|
'This web app is being served cache-first by a service ' +
|
||||||
|
'worker. To learn more, visit https://bit.ly/CRA-PWA'
|
||||||
|
);
|
||||||
|
});
|
||||||
|
} else {
|
||||||
|
// Is not localhost. Just register service worker
|
||||||
|
registerValidSW(swUrl, config);
|
||||||
|
}
|
||||||
|
});
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
function registerValidSW(swUrl: string, config?: Config) {
|
||||||
|
navigator.serviceWorker
|
||||||
|
.register(swUrl)
|
||||||
|
.then(registration => {
|
||||||
|
registration.onupdatefound = () => {
|
||||||
|
const installingWorker = registration.installing;
|
||||||
|
if (installingWorker == null) {
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
installingWorker.onstatechange = () => {
|
||||||
|
if (installingWorker.state === 'installed') {
|
||||||
|
if (navigator.serviceWorker.controller) {
|
||||||
|
// At this point, the updated precached content has been fetched,
|
||||||
|
// but the previous service worker will still serve the older
|
||||||
|
// content until all client tabs are closed.
|
||||||
|
console.log(
|
||||||
|
'New content is available and will be used when all ' +
|
||||||
|
'tabs for this page are closed. See https://bit.ly/CRA-PWA.'
|
||||||
|
);
|
||||||
|
|
||||||
|
// Execute callback
|
||||||
|
if (config && config.onUpdate) {
|
||||||
|
config.onUpdate(registration);
|
||||||
|
}
|
||||||
|
} else {
|
||||||
|
// At this point, everything has been precached.
|
||||||
|
// It's the perfect time to display a
|
||||||
|
// "Content is cached for offline use." message.
|
||||||
|
console.log('Content is cached for offline use.');
|
||||||
|
|
||||||
|
// Execute callback
|
||||||
|
if (config && config.onSuccess) {
|
||||||
|
config.onSuccess(registration);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
};
|
||||||
|
};
|
||||||
|
})
|
||||||
|
.catch(error => {
|
||||||
|
console.error('Error during service worker registration:', error);
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
|
function checkValidServiceWorker(swUrl: string, config?: Config) {
|
||||||
|
// Check if the service worker can be found. If it can't reload the page.
|
||||||
|
fetch(swUrl, {
|
||||||
|
headers: { 'Service-Worker': 'script' }
|
||||||
|
})
|
||||||
|
.then(response => {
|
||||||
|
// Ensure service worker exists, and that we really are getting a JS file.
|
||||||
|
const contentType = response.headers.get('content-type');
|
||||||
|
if (
|
||||||
|
response.status === 404 ||
|
||||||
|
(contentType != null && contentType.indexOf('javascript') === -1)
|
||||||
|
) {
|
||||||
|
// No service worker found. Probably a different app. Reload the page.
|
||||||
|
navigator.serviceWorker.ready.then(registration => {
|
||||||
|
registration.unregister().then(() => {
|
||||||
|
window.location.reload();
|
||||||
|
});
|
||||||
|
});
|
||||||
|
} else {
|
||||||
|
// Service worker found. Proceed as normal.
|
||||||
|
registerValidSW(swUrl, config);
|
||||||
|
}
|
||||||
|
})
|
||||||
|
.catch(() => {
|
||||||
|
console.log(
|
||||||
|
'No internet connection found. App is running in offline mode.'
|
||||||
|
);
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
|
export function unregister() {
|
||||||
|
if ('serviceWorker' in navigator) {
|
||||||
|
navigator.serviceWorker.ready.then(registration => {
|
||||||
|
registration.unregister();
|
||||||
|
});
|
||||||
|
}
|
||||||
|
}
|
|
@ -0,0 +1,5 @@
|
||||||
|
// jest-dom adds custom jest matchers for asserting on DOM nodes.
|
||||||
|
// allows you to do things like:
|
||||||
|
// expect(element).toHaveTextContent(/react/i)
|
||||||
|
// learn more: https://github.com/testing-library/jest-dom
|
||||||
|
import '@testing-library/jest-dom/extend-expect';
|
|
@ -0,0 +1,6 @@
|
||||||
|
import { createStyles, Theme, makeStyles } from "@material-ui/core/styles";
|
||||||
|
|
||||||
|
export const createStyle = (style: any) => {
|
||||||
|
const useStyles = makeStyles((theme: Theme) => createStyles(style));
|
||||||
|
return useStyles({});
|
||||||
|
};
|
|
@ -0,0 +1,17 @@
|
||||||
|
declare global {
|
||||||
|
interface Window {
|
||||||
|
_env_: any;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
let endpoint = `http://172.16.20.10:5000`;
|
||||||
|
if (window._env_ && window._env_.API_URL) {
|
||||||
|
endpoint = window._env_.API_URL;
|
||||||
|
}
|
||||||
|
|
||||||
|
export const Train = `${endpoint}/img/load`;
|
||||||
|
export const Processing = `${endpoint}/progress`;
|
||||||
|
export const Count = `${endpoint}/img/count`;
|
||||||
|
export const ClearAll = `${endpoint}/img/drop`;
|
||||||
|
export const Search = `${endpoint}/img/search`;
|
||||||
|
export const GetImageUrl = `${endpoint}/data`;
|
|
@ -0,0 +1,13 @@
|
||||||
|
let timeout: any = '';
|
||||||
|
export const delayRunFunc = (params: any, func: Function, time: number) => {
|
||||||
|
if (timeout) {
|
||||||
|
clearTimeout(timeout);
|
||||||
|
}
|
||||||
|
timeout = setTimeout(() => {
|
||||||
|
func(params);
|
||||||
|
}, time);
|
||||||
|
const r = () => {
|
||||||
|
clearTimeout(timeout);
|
||||||
|
};
|
||||||
|
return r;
|
||||||
|
};
|
|
@ -0,0 +1 @@
|
||||||
|
export const baseColor = '#3F9CD1';
|
|
@ -0,0 +1,25 @@
|
||||||
|
{
|
||||||
|
"compilerOptions": {
|
||||||
|
"target": "es5",
|
||||||
|
"lib": [
|
||||||
|
"dom",
|
||||||
|
"dom.iterable",
|
||||||
|
"esnext"
|
||||||
|
],
|
||||||
|
"allowJs": true,
|
||||||
|
"skipLibCheck": true,
|
||||||
|
"esModuleInterop": true,
|
||||||
|
"allowSyntheticDefaultImports": true,
|
||||||
|
"strict": true,
|
||||||
|
"forceConsistentCasingInFileNames": true,
|
||||||
|
"module": "esnext",
|
||||||
|
"moduleResolution": "node",
|
||||||
|
"resolveJsonModule": true,
|
||||||
|
"isolatedModules": true,
|
||||||
|
"noEmit": true,
|
||||||
|
"jsx": "react"
|
||||||
|
},
|
||||||
|
"include": [
|
||||||
|
"src"
|
||||||
|
]
|
||||||
|
}
|
|
@ -0,0 +1,106 @@
|
||||||
|
version: '3.5'
|
||||||
|
|
||||||
|
services:
|
||||||
|
etcd:
|
||||||
|
container_name: milvus-etcd
|
||||||
|
image: quay.io/coreos/etcd:v3.5.5
|
||||||
|
networks:
|
||||||
|
app_net:
|
||||||
|
environment:
|
||||||
|
- ETCD_AUTO_COMPACTION_MODE=revision
|
||||||
|
- ETCD_AUTO_COMPACTION_RETENTION=1000
|
||||||
|
- ETCD_QUOTA_BACKEND_BYTES=4294967296
|
||||||
|
- ETCD_SNAPSHOT_COUNT=50000
|
||||||
|
volumes:
|
||||||
|
- ${DOCKER_VOLUME_DIRECTORY:-.}/volumes/etcd:/etcd
|
||||||
|
command: etcd -advertise-client-urls=http://127.0.0.1:2379 -listen-client-urls http://0.0.0.0:2379 --data-dir /etcd
|
||||||
|
|
||||||
|
minio:
|
||||||
|
container_name: milvus-minio
|
||||||
|
image: minio/minio:RELEASE.2023-03-20T20-16-18Z
|
||||||
|
networks:
|
||||||
|
app_net:
|
||||||
|
environment:
|
||||||
|
MINIO_ACCESS_KEY: minioadmin
|
||||||
|
MINIO_SECRET_KEY: minioadmin
|
||||||
|
volumes:
|
||||||
|
- ${DOCKER_VOLUME_DIRECTORY:-.}/volumes/minio:/minio_data
|
||||||
|
command: minio server /minio_data
|
||||||
|
healthcheck:
|
||||||
|
test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
|
||||||
|
interval: 30s
|
||||||
|
timeout: 20s
|
||||||
|
retries: 3
|
||||||
|
|
||||||
|
standalone:
|
||||||
|
container_name: milvus-standalone
|
||||||
|
image: milvusdb/milvus:v2.2.10
|
||||||
|
networks:
|
||||||
|
app_net:
|
||||||
|
ipv4_address: 172.16.238.10
|
||||||
|
command: ["milvus", "run", "standalone"]
|
||||||
|
environment:
|
||||||
|
ETCD_ENDPOINTS: etcd:2379
|
||||||
|
MINIO_ADDRESS: minio:9000
|
||||||
|
volumes:
|
||||||
|
- ${DOCKER_VOLUME_DIRECTORY:-.}/volumes/milvus:/var/lib/milvus
|
||||||
|
ports:
|
||||||
|
- "19530:19530"
|
||||||
|
- "9091:9091"
|
||||||
|
depends_on:
|
||||||
|
- "etcd"
|
||||||
|
- "minio"
|
||||||
|
|
||||||
|
mysql:
|
||||||
|
container_name: img-search-mysql
|
||||||
|
image: mysql:5.7
|
||||||
|
networks:
|
||||||
|
app_net:
|
||||||
|
ipv4_address: 172.16.238.11
|
||||||
|
environment:
|
||||||
|
- MYSQL_ROOT_PASSWORD=123456
|
||||||
|
ports:
|
||||||
|
- "3306:3306"
|
||||||
|
|
||||||
|
webserver:
|
||||||
|
container_name: img-search-webserver
|
||||||
|
image: milvusbootcamp/img-search-server:2.2.10
|
||||||
|
networks:
|
||||||
|
app_net:
|
||||||
|
ipv4_address: 172.16.238.12
|
||||||
|
environment:
|
||||||
|
MILVUS_HOST: '172.16.238.10'
|
||||||
|
MYSQL_HOST: '172.16.238.11'
|
||||||
|
volumes:
|
||||||
|
- ./data:/data
|
||||||
|
restart: always
|
||||||
|
depends_on:
|
||||||
|
- standalone
|
||||||
|
- mysql
|
||||||
|
ports:
|
||||||
|
- "5000:5000"
|
||||||
|
|
||||||
|
webclient:
|
||||||
|
container_name: img-search-webclient
|
||||||
|
image: milvusbootcamp/img-search-client:2.2.10
|
||||||
|
networks:
|
||||||
|
app_net:
|
||||||
|
ipv4_address: 172.16.238.13
|
||||||
|
environment:
|
||||||
|
API_URL: 'http://127.0.0.1:5000'
|
||||||
|
ports:
|
||||||
|
- "8001:80"
|
||||||
|
healthcheck:
|
||||||
|
test: ["CMD", "curl", "-f", "http://127.0.0.1:8001"]
|
||||||
|
interval: 30s
|
||||||
|
timeout: 20s
|
||||||
|
retries: 3
|
||||||
|
|
||||||
|
networks:
|
||||||
|
app_net:
|
||||||
|
driver: bridge
|
||||||
|
ipam:
|
||||||
|
driver: default
|
||||||
|
config:
|
||||||
|
- subnet: 172.16.238.0/24
|
||||||
|
gateway: 172.16.238.1
|
After Width: | Height: | Size: 174 KiB |
After Width: | Height: | Size: 85 KiB |
After Width: | Height: | Size: 137 KiB |
After Width: | Height: | Size: 149 KiB |
After Width: | Height: | Size: 141 KiB |
After Width: | Height: | Size: 846 KiB |
After Width: | Height: | Size: 354 KiB |
|
@ -0,0 +1,13 @@
|
||||||
|
FROM python:3.7-slim-buster
|
||||||
|
|
||||||
|
RUN pip3 install --upgrade pip
|
||||||
|
RUN apt-get update
|
||||||
|
RUN apt-get install ffmpeg libsm6 libxext6 -y
|
||||||
|
|
||||||
|
WORKDIR /app/src
|
||||||
|
COPY . /app
|
||||||
|
|
||||||
|
RUN pip3 install -r /app/requirements.txt
|
||||||
|
RUN python3 encode.py
|
||||||
|
|
||||||
|
CMD python3 main.py
|
|
@ -0,0 +1,13 @@
|
||||||
|
PyMySQL==1.0.2
|
||||||
|
scipy
|
||||||
|
diskcache==5.2.1
|
||||||
|
uvicorn==0.13.4
|
||||||
|
numpy==1.21.3
|
||||||
|
pydantic==1.8.2
|
||||||
|
pymilvus==2.2.11
|
||||||
|
towhee==1.1.0
|
||||||
|
towhee.models==1.1.0
|
||||||
|
fastapi==0.65.2
|
||||||
|
python-multipart==0.0.5
|
||||||
|
pillow==8.4.0
|
||||||
|
aiofiles==0.7.0
|
|
@ -0,0 +1,23 @@
|
||||||
|
import os
|
||||||
|
|
||||||
|
############### Milvus Configuration ###############
|
||||||
|
MILVUS_HOST = os.getenv("MILVUS_HOST", "127.0.0.1")
|
||||||
|
MILVUS_PORT = int(os.getenv("MILVUS_PORT", "19530"))
|
||||||
|
VECTOR_DIMENSION = int(os.getenv("VECTOR_DIMENSION", "2048"))
|
||||||
|
INDEX_FILE_SIZE = int(os.getenv("INDEX_FILE_SIZE", "1024"))
|
||||||
|
METRIC_TYPE = os.getenv("METRIC_TYPE", "L2")
|
||||||
|
DEFAULT_TABLE = os.getenv("DEFAULT_TABLE", "milvus_img_search")
|
||||||
|
TOP_K = int(os.getenv("TOP_K", "10"))
|
||||||
|
|
||||||
|
############### MySQL Configuration ###############
|
||||||
|
MYSQL_HOST = os.getenv("MYSQL_HOST", "127.0.0.1")
|
||||||
|
MYSQL_PORT = int(os.getenv("MYSQL_PORT", "3306"))
|
||||||
|
MYSQL_USER = os.getenv("MYSQL_USER", "root")
|
||||||
|
MYSQL_PWD = os.getenv("MYSQL_PWD", "123456")
|
||||||
|
MYSQL_DB = os.getenv("MYSQL_DB", "mysql")
|
||||||
|
|
||||||
|
############### Data Path ###############
|
||||||
|
UPLOAD_PATH = os.getenv("UPLOAD_PATH", "tmp/search-images")
|
||||||
|
|
||||||
|
############### Number of log files ###############
|
||||||
|
LOGS_NUM = int(os.getenv("logs_num", "0"))
|
|
@ -0,0 +1,22 @@
|
||||||
|
from towhee import pipe, ops
|
||||||
|
|
||||||
|
|
||||||
|
class Resnet50:
|
||||||
|
def __init__(self):
|
||||||
|
self.image_embedding_pipe = (
|
||||||
|
pipe.input('path')
|
||||||
|
.map('path', 'img', ops.image_decode.cv2_rgb())
|
||||||
|
.map('img', 'embedding', ops.image_embedding.timm(model_name='resnet50'))
|
||||||
|
.map('embedding', 'embedding', ops.towhee.np_normalize())
|
||||||
|
.output('embedding')
|
||||||
|
)
|
||||||
|
|
||||||
|
def resnet50_extract_feat(self, img_path):
|
||||||
|
feat = self.image_embedding_pipe(img_path)
|
||||||
|
return feat.get()[0]
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == '__main__':
|
||||||
|
MODEL = Resnet50()
|
||||||
|
# Warm up the model to build image
|
||||||
|
MODEL.resnet50_extract_feat('https://raw.githubusercontent.com/towhee-io/towhee/main/towhee_logo.png')
|
|
@ -0,0 +1,129 @@
|
||||||
|
import os
|
||||||
|
import re
|
||||||
|
import datetime
|
||||||
|
import logging
|
||||||
|
import sys
|
||||||
|
from config import LOGS_NUM
|
||||||
|
|
||||||
|
try:
|
||||||
|
import codecs
|
||||||
|
except ImportError:
|
||||||
|
codecs = None
|
||||||
|
|
||||||
|
|
||||||
|
class MultiprocessHandler(logging.FileHandler):
|
||||||
|
"""
|
||||||
|
Say something about the ExampleCalass...
|
||||||
|
|
||||||
|
Args:
|
||||||
|
args_0 (`type`):
|
||||||
|
...
|
||||||
|
"""
|
||||||
|
def __init__(self, filename, when='D', backupCount=0, encoding=None, delay=False):
|
||||||
|
self.prefix = filename
|
||||||
|
self.backupCount = backupCount
|
||||||
|
self.when = when.upper()
|
||||||
|
self.extMath = r"^\d{4}-\d{2}-\d{2}"
|
||||||
|
|
||||||
|
self.when_dict = {
|
||||||
|
'S': "%Y-%m-%d-%H-%M-%S",
|
||||||
|
'M': "%Y-%m-%d-%H-%M",
|
||||||
|
'H': "%Y-%m-%d-%H",
|
||||||
|
'D': "%Y-%m-%d"
|
||||||
|
}
|
||||||
|
|
||||||
|
self.suffix = self.when_dict.get(when)
|
||||||
|
if not self.suffix:
|
||||||
|
print('The specified date interval unit is invalid: ', self.when)
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
self.filefmt = os.path.join('.', "logs", f"{self.prefix}-{self.suffix}.log")
|
||||||
|
|
||||||
|
self.filePath = datetime.datetime.now().strftime(self.filefmt)
|
||||||
|
|
||||||
|
_dir = os.path.dirname(self.filefmt)
|
||||||
|
try:
|
||||||
|
if not os.path.exists(_dir):
|
||||||
|
os.makedirs(_dir)
|
||||||
|
except Exception as e:
|
||||||
|
print('Failed to create log file: ', e)
|
||||||
|
print("log_path:" + self.filePath)
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
if codecs is None:
|
||||||
|
encoding = None
|
||||||
|
|
||||||
|
logging.FileHandler.__init__(self, self.filePath, 'a+', encoding, delay)
|
||||||
|
|
||||||
|
def shouldChangeFileToWrite(self):
|
||||||
|
_filePath = datetime.datetime.now().strftime(self.filefmt)
|
||||||
|
if _filePath != self.filePath:
|
||||||
|
self.filePath = _filePath
|
||||||
|
return True
|
||||||
|
return False
|
||||||
|
|
||||||
|
def doChangeFile(self):
|
||||||
|
self.baseFilename = os.path.abspath(self.filePath)
|
||||||
|
if self.stream:
|
||||||
|
self.stream.close()
|
||||||
|
self.stream = None
|
||||||
|
|
||||||
|
if not self.delay:
|
||||||
|
self.stream = self._open()
|
||||||
|
if self.backupCount > 0:
|
||||||
|
for s in self.getFilesToDelete():
|
||||||
|
os.remove(s)
|
||||||
|
|
||||||
|
def getFilesToDelete(self):
|
||||||
|
dir_name, _ = os.path.split(self.baseFilename)
|
||||||
|
file_names = os.listdir(dir_name)
|
||||||
|
result = []
|
||||||
|
prefix = self.prefix + '-'
|
||||||
|
for file_name in file_names:
|
||||||
|
if file_name[:len(prefix)] == prefix:
|
||||||
|
suffix = file_name[len(prefix):-4]
|
||||||
|
if re.compile(self.extMath).match(suffix):
|
||||||
|
result.append(os.path.join(dir_name, file_name))
|
||||||
|
result.sort()
|
||||||
|
|
||||||
|
if len(result) < self.backupCount:
|
||||||
|
result = []
|
||||||
|
else:
|
||||||
|
result = result[:len(result) - self.backupCount]
|
||||||
|
return result
|
||||||
|
|
||||||
|
def emit(self, record):
|
||||||
|
try:
|
||||||
|
if self.shouldChangeFileToWrite():
|
||||||
|
self.doChangeFile()
|
||||||
|
logging.FileHandler.emit(self, record)
|
||||||
|
except (KeyboardInterrupt, SystemExit):
|
||||||
|
raise
|
||||||
|
except:
|
||||||
|
self.handleError(record)
|
||||||
|
|
||||||
|
|
||||||
|
def write_log():
|
||||||
|
logger = logging.getLogger()
|
||||||
|
logger.setLevel(logging.DEBUG)
|
||||||
|
# formatter = '%(asctime)s | %(levelname)s | %(filename)s | %(funcName)s | %(module)s | %(lineno)s | %(message)s'
|
||||||
|
fmt = logging.Formatter(
|
||||||
|
'%(asctime)s | %(levelname)s | %(filename)s | %(funcName)s | %(lineno)s | %(message)s')
|
||||||
|
|
||||||
|
stream_handler = logging.StreamHandler(sys.stdout)
|
||||||
|
stream_handler.setLevel(logging.INFO)
|
||||||
|
stream_handler.setFormatter(fmt)
|
||||||
|
|
||||||
|
log_name = "milvus"
|
||||||
|
file_handler = MultiprocessHandler(log_name, when='D', backupCount=LOGS_NUM)
|
||||||
|
file_handler.setLevel(logging.DEBUG)
|
||||||
|
file_handler.setFormatter(fmt)
|
||||||
|
file_handler.doChangeFile()
|
||||||
|
|
||||||
|
logger.addHandler(stream_handler)
|
||||||
|
logger.addHandler(file_handler)
|
||||||
|
|
||||||
|
return logger
|
||||||
|
|
||||||
|
|
||||||
|
LOGGER = write_log()
|
|
@ -0,0 +1,143 @@
|
||||||
|
import uvicorn
|
||||||
|
import os
|
||||||
|
from diskcache import Cache
|
||||||
|
from fastapi import FastAPI, File, UploadFile
|
||||||
|
from fastapi.param_functions import Form
|
||||||
|
from starlette.middleware.cors import CORSMiddleware
|
||||||
|
from starlette.responses import FileResponse
|
||||||
|
from encode import Resnet50
|
||||||
|
from milvus_helpers import MilvusHelper
|
||||||
|
from mysql_helpers import MySQLHelper
|
||||||
|
from config import TOP_K, UPLOAD_PATH
|
||||||
|
from operations.load import do_load
|
||||||
|
from operations.upload import do_upload
|
||||||
|
from operations.search import do_search
|
||||||
|
from operations.count import do_count
|
||||||
|
from operations.drop import do_drop
|
||||||
|
from logs import LOGGER
|
||||||
|
from pydantic import BaseModel
|
||||||
|
from typing import Optional
|
||||||
|
from urllib.request import urlretrieve
|
||||||
|
|
||||||
|
app = FastAPI()
|
||||||
|
origins = ["*"]
|
||||||
|
app.add_middleware(
|
||||||
|
CORSMiddleware,
|
||||||
|
allow_origins=origins,
|
||||||
|
allow_credentials=True,
|
||||||
|
allow_methods=["*"],
|
||||||
|
allow_headers=["*"],
|
||||||
|
|
||||||
|
)
|
||||||
|
MODEL = Resnet50()
|
||||||
|
MILVUS_CLI = MilvusHelper()
|
||||||
|
MYSQL_CLI = MySQLHelper()
|
||||||
|
|
||||||
|
# Mkdir '/tmp/search-images'
|
||||||
|
if not os.path.exists(UPLOAD_PATH):
|
||||||
|
os.makedirs(UPLOAD_PATH)
|
||||||
|
LOGGER.info(f"mkdir the path:{UPLOAD_PATH}")
|
||||||
|
|
||||||
|
@app.get('/data')
|
||||||
|
def get_img(image_path):
|
||||||
|
# Get the image file
|
||||||
|
try:
|
||||||
|
LOGGER.info(f"Successfully load image: {image_path}")
|
||||||
|
return FileResponse(image_path)
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Get image error: {e}")
|
||||||
|
return {'status': False, 'msg': e}, 400
|
||||||
|
|
||||||
|
|
||||||
|
@app.get('/progress')
|
||||||
|
def get_progress():
|
||||||
|
# Get the progress of dealing with images
|
||||||
|
try:
|
||||||
|
cache = Cache('./tmp')
|
||||||
|
return f"current: {cache['current']}, total: {cache['total']}"
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"upload image error: {e}")
|
||||||
|
return {'status': False, 'msg': e}, 400
|
||||||
|
|
||||||
|
class Item(BaseModel):
|
||||||
|
Table: Optional[str] = None
|
||||||
|
File: str
|
||||||
|
|
||||||
|
@app.post('/img/load')
|
||||||
|
async def load_images(item: Item):
|
||||||
|
# Insert all the image under the file path to Milvus/MySQL
|
||||||
|
try:
|
||||||
|
total_num = do_load(item.Table, item.File, MODEL, MILVUS_CLI, MYSQL_CLI)
|
||||||
|
LOGGER.info(f"Successfully loaded data, total count: {total_num}")
|
||||||
|
return "Successfully loaded data!"
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(e)
|
||||||
|
return {'status': False, 'msg': e}, 400
|
||||||
|
|
||||||
|
@app.post('/img/upload')
|
||||||
|
async def upload_images(image: UploadFile = File(None), url: str = None, table_name: str = None):
|
||||||
|
# Insert the upload image to Milvus/MySQL
|
||||||
|
try:
|
||||||
|
# Save the upload image to server.
|
||||||
|
if image is not None:
|
||||||
|
content = await image.read()
|
||||||
|
img_path = os.path.join(UPLOAD_PATH, image.filename)
|
||||||
|
with open(img_path, "wb+") as f:
|
||||||
|
f.write(content)
|
||||||
|
elif url is not None:
|
||||||
|
img_path = os.path.join(UPLOAD_PATH, os.path.basename(url))
|
||||||
|
urlretrieve(url, img_path)
|
||||||
|
else:
|
||||||
|
return {'status': False, 'msg': 'Image and url are required'}, 400
|
||||||
|
vector_id = do_upload(table_name, img_path, MODEL, MILVUS_CLI, MYSQL_CLI)
|
||||||
|
LOGGER.info(f"Successfully uploaded data, vector id: {vector_id}")
|
||||||
|
return "Successfully loaded data: " + str(vector_id)
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(e)
|
||||||
|
return {'status': False, 'msg': e}, 400
|
||||||
|
|
||||||
|
@app.post('/img/search')
|
||||||
|
async def search_images(image: UploadFile = File(...), topk: int = Form(TOP_K), table_name: str = None):
|
||||||
|
# Search the upload image in Milvus/MySQL
|
||||||
|
try:
|
||||||
|
# Save the upload image to server.
|
||||||
|
content = await image.read()
|
||||||
|
img_path = os.path.join(UPLOAD_PATH, image.filename)
|
||||||
|
with open(img_path, "wb+") as f:
|
||||||
|
f.write(content)
|
||||||
|
paths, distances = do_search(table_name, img_path, topk, MODEL, MILVUS_CLI, MYSQL_CLI)
|
||||||
|
res = dict(zip(paths, distances))
|
||||||
|
res = sorted(res.items(), key=lambda item: item[1])
|
||||||
|
LOGGER.info("Successfully searched similar images!")
|
||||||
|
return res
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(e)
|
||||||
|
return {'status': False, 'msg': e}, 400
|
||||||
|
|
||||||
|
|
||||||
|
@app.post('/img/count')
|
||||||
|
async def count_images(table_name: str = None):
|
||||||
|
# Returns the total number of images in the system
|
||||||
|
try:
|
||||||
|
num = do_count(table_name, MILVUS_CLI)
|
||||||
|
LOGGER.info("Successfully count the number of images!")
|
||||||
|
return num
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(e)
|
||||||
|
return {'status': False, 'msg': e}, 400
|
||||||
|
|
||||||
|
|
||||||
|
@app.post('/img/drop')
|
||||||
|
async def drop_tables(table_name: str = None):
|
||||||
|
# Delete the collection of Milvus and MySQL
|
||||||
|
try:
|
||||||
|
status = do_drop(table_name, MILVUS_CLI, MYSQL_CLI)
|
||||||
|
LOGGER.info("Successfully drop tables in Milvus and MySQL!")
|
||||||
|
return status
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(e)
|
||||||
|
return {'status': False, 'msg': e}, 400
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == '__main__':
|
||||||
|
uvicorn.run(app=app, host='0.0.0.0', port=5000)
|
|
@ -0,0 +1,113 @@
|
||||||
|
import sys
|
||||||
|
from config import MILVUS_HOST, MILVUS_PORT, VECTOR_DIMENSION, METRIC_TYPE
|
||||||
|
from pymilvus import connections, FieldSchema, CollectionSchema, DataType, Collection, utility
|
||||||
|
from logs import LOGGER
|
||||||
|
|
||||||
|
|
||||||
|
class MilvusHelper:
|
||||||
|
"""
|
||||||
|
Milvus Helper
|
||||||
|
"""
|
||||||
|
def __init__(self):
|
||||||
|
try:
|
||||||
|
self.collection = None
|
||||||
|
connections.connect(host=MILVUS_HOST, port=MILVUS_PORT)
|
||||||
|
LOGGER.debug(f"Successfully connect to Milvus with IP:{MILVUS_HOST} and PORT:{MILVUS_PORT}")
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to connect Milvus: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def set_collection(self, collection_name):
|
||||||
|
try:
|
||||||
|
self.collection = Collection(name=collection_name)
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to set collection in Milvus: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def has_collection(self, collection_name):
|
||||||
|
# Return if Milvus has the collection
|
||||||
|
try:
|
||||||
|
return utility.has_collection(collection_name)
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to get collection info to Milvus: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def create_collection(self, collection_name):
|
||||||
|
# Create milvus collection if not exists
|
||||||
|
try:
|
||||||
|
field1 = FieldSchema(name="id", dtype=DataType.INT64, description="int64", is_primary=True, auto_id=True)
|
||||||
|
field2 = FieldSchema(name="embedding", dtype=DataType.FLOAT_VECTOR, description="float vector",
|
||||||
|
dim=VECTOR_DIMENSION, is_primary=False)
|
||||||
|
schema = CollectionSchema(fields=[field1, field2], description="collection description")
|
||||||
|
self.collection = Collection(name=collection_name, schema=schema)
|
||||||
|
LOGGER.debug(f"Create Milvus collection: {collection_name}")
|
||||||
|
return "OK"
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed create collection in Milvus: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def insert(self, collection_name, vectors):
|
||||||
|
# Batch insert vectors to milvus collection
|
||||||
|
try:
|
||||||
|
self.set_collection(collection_name)
|
||||||
|
data = [vectors]
|
||||||
|
mr = self.collection.insert(data)
|
||||||
|
ids = mr.primary_keys
|
||||||
|
LOGGER.debug(
|
||||||
|
f"Insert vectors to Milvus in collection: {collection_name} with {len(vectors)} rows")
|
||||||
|
return ids
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to insert data to Milvus: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def create_index(self, collection_name):
|
||||||
|
# Create IVF_FLAT index on milvus collection
|
||||||
|
try:
|
||||||
|
self.set_collection(collection_name)
|
||||||
|
default_index = {"metric_type": METRIC_TYPE, "index_type": "IVF_FLAT", "params": {"nlist": 2048}}
|
||||||
|
status = self.collection.create_index(field_name="embedding", index_params=default_index)
|
||||||
|
if not status.code:
|
||||||
|
LOGGER.debug(
|
||||||
|
f"Successfully create index in collection:{collection_name} with param:{default_index}")
|
||||||
|
return status
|
||||||
|
else:
|
||||||
|
raise Exception(status.message)
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to create index: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def delete_collection(self, collection_name):
|
||||||
|
# Delete Milvus collection
|
||||||
|
try:
|
||||||
|
self.set_collection(collection_name)
|
||||||
|
self.collection.drop()
|
||||||
|
LOGGER.debug("Successfully drop collection!")
|
||||||
|
return "ok"
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to drop collection: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def search_vectors(self, collection_name, vectors, top_k):
|
||||||
|
# Search vector in milvus collection
|
||||||
|
try:
|
||||||
|
self.set_collection(collection_name)
|
||||||
|
self.collection.load()
|
||||||
|
search_params = {"metric_type": METRIC_TYPE, "params": {"nprobe": 16}}
|
||||||
|
res = self.collection.search(vectors, anns_field="embedding", param=search_params, limit=top_k)
|
||||||
|
LOGGER.debug(f"Successfully search in collection: {res}")
|
||||||
|
return res
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to search vectors in Milvus: {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def count(self, collection_name):
|
||||||
|
# Get the number of milvus collection
|
||||||
|
try:
|
||||||
|
self.set_collection(collection_name)
|
||||||
|
self.collection.flush()
|
||||||
|
num = self.collection.num_entities
|
||||||
|
LOGGER.debug(f"Successfully get the num:{num} of the collection:{collection_name}")
|
||||||
|
return num
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Failed to count vectors in Milvus: {e}")
|
||||||
|
sys.exit(1)
|
|
@ -0,0 +1,101 @@
|
||||||
|
import sys
|
||||||
|
import pymysql
|
||||||
|
from config import MYSQL_HOST, MYSQL_PORT, MYSQL_USER, MYSQL_PWD, MYSQL_DB
|
||||||
|
from logs import LOGGER
|
||||||
|
|
||||||
|
|
||||||
|
class MySQLHelper():
|
||||||
|
"""
|
||||||
|
Say something about the ExampleCalass...
|
||||||
|
|
||||||
|
Args:
|
||||||
|
args_0 (`type`):
|
||||||
|
...
|
||||||
|
"""
|
||||||
|
def __init__(self):
|
||||||
|
self.conn = pymysql.connect(host=MYSQL_HOST, user=MYSQL_USER, port=MYSQL_PORT, password=MYSQL_PWD,
|
||||||
|
database=MYSQL_DB,
|
||||||
|
local_infile=True)
|
||||||
|
self.cursor = self.conn.cursor()
|
||||||
|
|
||||||
|
def test_connection(self):
|
||||||
|
try:
|
||||||
|
self.conn.ping()
|
||||||
|
except Exception:
|
||||||
|
self.conn = pymysql.connect(host=MYSQL_HOST, user=MYSQL_USER, port=MYSQL_PORT, password=MYSQL_PWD,
|
||||||
|
database=MYSQL_DB,local_infile=True)
|
||||||
|
self.cursor = self.conn.cursor()
|
||||||
|
|
||||||
|
def create_mysql_table(self, table_name):
|
||||||
|
# Create mysql table if not exists
|
||||||
|
self.test_connection()
|
||||||
|
sql = "create table if not exists " + table_name + "(milvus_id TEXT, image_path TEXT);"
|
||||||
|
try:
|
||||||
|
self.cursor.execute(sql)
|
||||||
|
LOGGER.debug(f"MYSQL create table: {table_name} with sql: {sql}")
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def load_data_to_mysql(self, table_name, data):
|
||||||
|
# Batch insert (Milvus_ids, img_path) to mysql
|
||||||
|
self.test_connection()
|
||||||
|
sql = "insert into " + table_name + " (milvus_id,image_path) values (%s,%s);"
|
||||||
|
try:
|
||||||
|
self.cursor.executemany(sql, data)
|
||||||
|
self.conn.commit()
|
||||||
|
LOGGER.debug(f"MYSQL loads data to table: {table_name} successfully")
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def search_by_milvus_ids(self, ids, table_name):
|
||||||
|
# Get the img_path according to the milvus ids
|
||||||
|
self.test_connection()
|
||||||
|
str_ids = str(ids).replace('[', '').replace(']', '')
|
||||||
|
sql = "select image_path from " + table_name + " where milvus_id in (" + str_ids + ") order by field (milvus_id," + str_ids + ");"
|
||||||
|
try:
|
||||||
|
self.cursor.execute(sql)
|
||||||
|
results = self.cursor.fetchall()
|
||||||
|
results = [res[0] for res in results]
|
||||||
|
LOGGER.debug("MYSQL search by milvus id.")
|
||||||
|
return results
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def delete_table(self, table_name):
|
||||||
|
# Delete mysql table if exists
|
||||||
|
self.test_connection()
|
||||||
|
sql = "drop table if exists " + table_name + ";"
|
||||||
|
try:
|
||||||
|
self.cursor.execute(sql)
|
||||||
|
LOGGER.debug(f"MYSQL delete table:{table_name}")
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def delete_all_data(self, table_name):
|
||||||
|
# Delete all the data in mysql table
|
||||||
|
self.test_connection()
|
||||||
|
sql = 'delete from ' + table_name + ';'
|
||||||
|
try:
|
||||||
|
self.cursor.execute(sql)
|
||||||
|
self.conn.commit()
|
||||||
|
LOGGER.debug(f"MYSQL delete all data in table:{table_name}")
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
def count_table(self, table_name):
|
||||||
|
# Get the number of mysql table
|
||||||
|
self.test_connection()
|
||||||
|
sql = "select count(milvus_id) from " + table_name + ";"
|
||||||
|
try:
|
||||||
|
self.cursor.execute(sql)
|
||||||
|
results = self.cursor.fetchall()
|
||||||
|
LOGGER.debug(f"MYSQL count table:{table_name}")
|
||||||
|
return results[0][0]
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
|
||||||
|
sys.exit(1)
|
|
@ -0,0 +1,16 @@
|
||||||
|
import sys
|
||||||
|
from config import DEFAULT_TABLE
|
||||||
|
from logs import LOGGER
|
||||||
|
from milvus_helpers import MilvusHelper
|
||||||
|
|
||||||
|
def do_count(table_name: str, milvus_cli: MilvusHelper):
|
||||||
|
if not table_name:
|
||||||
|
table_name = DEFAULT_TABLE
|
||||||
|
try:
|
||||||
|
if not milvus_cli.has_collection(table_name):
|
||||||
|
return None
|
||||||
|
num = milvus_cli.count(table_name)
|
||||||
|
return num
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Error with count table {e}")
|
||||||
|
sys.exit(1)
|
|
@ -0,0 +1,19 @@
|
||||||
|
import sys
|
||||||
|
from config import DEFAULT_TABLE
|
||||||
|
from logs import LOGGER
|
||||||
|
from milvus_helpers import MilvusHelper
|
||||||
|
from mysql_helpers import MySQLHelper
|
||||||
|
|
||||||
|
|
||||||
|
def do_drop(table_name: str, milvus_cli: MilvusHelper, mysql_cli: MySQLHelper):
|
||||||
|
if not table_name:
|
||||||
|
table_name = DEFAULT_TABLE
|
||||||
|
try:
|
||||||
|
if not milvus_cli.has_collection(table_name):
|
||||||
|
return f"Milvus doesn't have a collection named {table_name}"
|
||||||
|
status = milvus_cli.delete_collection(table_name)
|
||||||
|
mysql_cli.delete_table(table_name)
|
||||||
|
return status
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Error with drop table: {e}")
|
||||||
|
sys.exit(1)
|
|
@ -0,0 +1,63 @@
|
||||||
|
import sys
|
||||||
|
import os
|
||||||
|
from diskcache import Cache
|
||||||
|
from config import DEFAULT_TABLE
|
||||||
|
from logs import LOGGER
|
||||||
|
from milvus_helpers import MilvusHelper
|
||||||
|
from mysql_helpers import MySQLHelper
|
||||||
|
from encode import Resnet50
|
||||||
|
|
||||||
|
|
||||||
|
# Get the path to the image
|
||||||
|
def get_imgs(path):
|
||||||
|
pics = []
|
||||||
|
for f in os.listdir(path):
|
||||||
|
if ((f.endswith(extension) for extension in
|
||||||
|
['.png', '.jpg', '.jpeg', '.PNG', '.JPG', '.JPEG']) and not f.startswith('.DS_Store')):
|
||||||
|
pics.append(os.path.join(path, f))
|
||||||
|
return pics
|
||||||
|
|
||||||
|
|
||||||
|
# Get the vector of images
|
||||||
|
def extract_features(img_dir, model):
|
||||||
|
try:
|
||||||
|
cache = Cache('./tmp')
|
||||||
|
feats = []
|
||||||
|
names = []
|
||||||
|
img_list = get_imgs(img_dir)
|
||||||
|
total = len(img_list)
|
||||||
|
cache['total'] = total
|
||||||
|
for i, img_path in enumerate(img_list):
|
||||||
|
try:
|
||||||
|
norm_feat = model.resnet50_extract_feat(img_path)
|
||||||
|
feats.append(norm_feat)
|
||||||
|
names.append(img_path.encode())
|
||||||
|
cache['current'] = i + 1
|
||||||
|
LOGGER.info(f"Extracting feature from image No. {i + 1} , {total} images in total")
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Error with extracting feature from image {e}")
|
||||||
|
continue
|
||||||
|
return feats, names
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Error with extracting feature from image {e}")
|
||||||
|
sys.exit(1)
|
||||||
|
|
||||||
|
|
||||||
|
# Combine the id of the vector and the name of the image into a list
|
||||||
|
def format_data(ids, names):
|
||||||
|
data = [(str(i), n) for i, n in zip(ids, names)]
|
||||||
|
return data
|
||||||
|
|
||||||
|
|
||||||
|
# Import vectors to Milvus and data to Mysql respectively
|
||||||
|
def do_load(table_name: str, image_dir: str, model: Resnet50, milvus_client: MilvusHelper, mysql_cli: MySQLHelper):
|
||||||
|
if not table_name:
|
||||||
|
table_name = DEFAULT_TABLE
|
||||||
|
if not milvus_client.has_collection(table_name):
|
||||||
|
milvus_client.create_collection(table_name)
|
||||||
|
milvus_client.create_index(table_name)
|
||||||
|
vectors, names = extract_features(image_dir, model)
|
||||||
|
ids = milvus_client.insert(table_name, vectors)
|
||||||
|
mysql_cli.create_mysql_table(table_name)
|
||||||
|
mysql_cli.load_data_to_mysql(table_name, format_data(ids, names))
|
||||||
|
return len(ids)
|
|
@ -0,0 +1,21 @@
|
||||||
|
import sys
|
||||||
|
from config import DEFAULT_TABLE
|
||||||
|
from logs import LOGGER
|
||||||
|
from milvus_helpers import MilvusHelper
|
||||||
|
from mysql_helpers import MySQLHelper
|
||||||
|
from encode import Resnet50
|
||||||
|
|
||||||
|
|
||||||
|
def do_search(table_name: str, img_path: str, top_k: int, model: Resnet50, milvus_client: MilvusHelper, mysql_cli: MySQLHelper):
|
||||||
|
try:
|
||||||
|
if not table_name:
|
||||||
|
table_name = DEFAULT_TABLE
|
||||||
|
feat = model.resnet50_extract_feat(img_path)
|
||||||
|
vectors = milvus_client.search_vectors(table_name, [feat], top_k)
|
||||||
|
vids = [str(x.id) for x in vectors[0]]
|
||||||
|
paths = mysql_cli.search_by_milvus_ids(vids, table_name)
|
||||||
|
distances = [x.distance for x in vectors[0]]
|
||||||
|
return paths, distances
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Error with search : {e}")
|
||||||
|
sys.exit(1)
|
|
@ -0,0 +1,22 @@
|
||||||
|
import sys
|
||||||
|
from config import DEFAULT_TABLE
|
||||||
|
from logs import LOGGER
|
||||||
|
from milvus_helpers import MilvusHelper
|
||||||
|
from mysql_helpers import MySQLHelper
|
||||||
|
from encode import Resnet50
|
||||||
|
|
||||||
|
def do_upload(table_name: str, img_path: str, model: Resnet50, milvus_client: MilvusHelper, mysql_cli: MySQLHelper):
|
||||||
|
try:
|
||||||
|
if not table_name:
|
||||||
|
table_name = DEFAULT_TABLE
|
||||||
|
if not milvus_client.has_collection(table_name):
|
||||||
|
milvus_client.create_collection(table_name)
|
||||||
|
milvus_client.create_index(table_name)
|
||||||
|
feat = model.resnet50_extract_feat(img_path)
|
||||||
|
ids = milvus_client.insert(table_name, [feat])
|
||||||
|
mysql_cli.create_mysql_table(table_name)
|
||||||
|
mysql_cli.load_data_to_mysql(table_name, [(str(ids[0]), img_path.encode())])
|
||||||
|
return ids[0]
|
||||||
|
except Exception as e:
|
||||||
|
LOGGER.error(f"Error with upload : {e}")
|
||||||
|
sys.exit(1)
|
|
@ -0,0 +1,50 @@
|
||||||
|
from fastapi.testclient import TestClient
|
||||||
|
import gdown
|
||||||
|
import zipfile
|
||||||
|
from main import app
|
||||||
|
|
||||||
|
client = TestClient(app)
|
||||||
|
|
||||||
|
def get_file():
|
||||||
|
url = 'https://drive.google.com/uc?id=1omhIvzbXM9t0mU3hDFqLDpbKpwqyW__b'
|
||||||
|
gdown.download(url)
|
||||||
|
|
||||||
|
with zipfile.ZipFile('example_img.zip', 'r') as zip_ref:
|
||||||
|
zip_ref.extractall('./')
|
||||||
|
|
||||||
|
def test_drop():
|
||||||
|
response = client.post('/img/drop')
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
def test_load_img():
|
||||||
|
get_file()
|
||||||
|
response = client.post(
|
||||||
|
'/img/load',
|
||||||
|
json={"File": "./example_img"}
|
||||||
|
)
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
def test_progress():
|
||||||
|
response = client.get('/progress')
|
||||||
|
assert response.status_code == 200
|
||||||
|
assert response.json() == "current: 20, total: 20"
|
||||||
|
|
||||||
|
def test_count():
|
||||||
|
response = client.post('/img/count')
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
def test_get_img():
|
||||||
|
response = client.get('/data?image_path=.%2Fexample_img%2Ftest.jpg')
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
def test_upload_img():
|
||||||
|
_test_upload_file = './example_img/test.jpg'
|
||||||
|
_files = {'image': open(_test_upload_file, 'rb')}
|
||||||
|
response = client.post('/img/upload', files = _files)
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
def test_search():
|
||||||
|
_test_upload_file = './example_img/test.jpg'
|
||||||
|
_files = {'image': open(_test_upload_file, 'rb')}
|
||||||
|
response = client.post('/img/search', files = _files)
|
||||||
|
assert response.status_code == 200
|
|
@ -0,0 +1,58 @@
|
||||||
|
import requests
|
||||||
|
import gdown
|
||||||
|
import zipfile
|
||||||
|
|
||||||
|
def get_file():
|
||||||
|
url = 'https://drive.google.com/uc?id=1omhIvzbXM9t0mU3hDFqLDpbKpwqyW__b'
|
||||||
|
gdown.download(url)
|
||||||
|
|
||||||
|
with zipfile.ZipFile('example_img.zip', 'r') as zip_ref:
|
||||||
|
zip_ref.extractall('./data')
|
||||||
|
|
||||||
|
def test_load():
|
||||||
|
get_file()
|
||||||
|
response = requests.post(
|
||||||
|
"http://127.0.0.1:5000/img/load",
|
||||||
|
json={"File": "/data/example_img"}
|
||||||
|
)
|
||||||
|
assert response.status_code == 200
|
||||||
|
assert response.json() == "Successfully loaded data!"
|
||||||
|
|
||||||
|
def test_progress():
|
||||||
|
response = requests.get("http://127.0.0.1:5000/progress")
|
||||||
|
assert response.status_code == 200
|
||||||
|
assert response.json() == "current: 20, total: 20"
|
||||||
|
|
||||||
|
def test_count():
|
||||||
|
response = requests.post("http://127.0.0.1:5000/img/count")
|
||||||
|
assert response.status_code == 200
|
||||||
|
assert response.json() == 20
|
||||||
|
|
||||||
|
def test_get_img():
|
||||||
|
response = requests.get(
|
||||||
|
'http://127.0.0.1:5000/data?image_path=%2Fdata%2Fexample_img%2Ftest.jpg'
|
||||||
|
)
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
def test_upload_img():
|
||||||
|
_test_upload_file = './data/example_img/test.jpg'
|
||||||
|
_files = {'image': open(_test_upload_file, 'rb')}
|
||||||
|
response = requests.post(
|
||||||
|
'http://127.0.0.1:5000/img/upload',
|
||||||
|
files = _files
|
||||||
|
)
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
def test_search():
|
||||||
|
_test_upload_file = './data/example_img/test.jpg'
|
||||||
|
_files = {'image': open(_test_upload_file, 'rb')}
|
||||||
|
response = requests.post(
|
||||||
|
'http://127.0.0.1:5000/img/search',
|
||||||
|
files = _files
|
||||||
|
)
|
||||||
|
assert response.status_code == 200
|
||||||
|
|
||||||
|
|
||||||
|
def test_drop():
|
||||||
|
response = requests.post("http://127.0.0.1:5000/img/drop")
|
||||||
|
assert response.status_code == 200
|
|
@ -0,0 +1 @@
|
||||||
|
MANIFEST-000022
|
|
@ -0,0 +1 @@
|
||||||
|
d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d
|
|
@ -0,0 +1,395 @@
|
||||||
|
2023/09/26-17:03:48.701850 14 RocksDB version: 6.27.3
|
||||||
|
2023/09/26-17:03:48.701866 14 Git sha 0
|
||||||
|
2023/09/26-17:03:48.701867 14 Compile date 2023-06-14 04:09:40
|
||||||
|
2023/09/26-17:03:48.701868 14 DB SUMMARY
|
||||||
|
2023/09/26-17:03:48.701868 14 DB Session ID: 345C9WGIGWXHNGD85BUN
|
||||||
|
2023/09/26-17:03:48.701885 14 CURRENT file: CURRENT
|
||||||
|
2023/09/26-17:03:48.701886 14 IDENTITY file: IDENTITY
|
||||||
|
2023/09/26-17:03:48.701890 14 MANIFEST file: MANIFEST-000016 size: 345 Bytes
|
||||||
|
2023/09/26-17:03:48.701892 14 SST files in /var/lib/milvus/rdb_data dir, Total Num: 2, files: 000009.sst 000015.sst
|
||||||
|
2023/09/26-17:03:48.701893 14 Write Ahead Log file in /var/lib/milvus/rdb_data: 000017.log size: 21716486 ;
|
||||||
|
2023/09/26-17:03:48.701894 14 Options.error_if_exists: 0
|
||||||
|
2023/09/26-17:03:48.701895 14 Options.create_if_missing: 1
|
||||||
|
2023/09/26-17:03:48.701895 14 Options.paranoid_checks: 1
|
||||||
|
2023/09/26-17:03:48.701896 14 Options.flush_verify_memtable_count: 1
|
||||||
|
2023/09/26-17:03:48.701897 14 Options.track_and_verify_wals_in_manifest: 0
|
||||||
|
2023/09/26-17:03:48.701897 14 Options.env: 0x5e1d140
|
||||||
|
2023/09/26-17:03:48.701898 14 Options.fs: PosixFileSystem
|
||||||
|
2023/09/26-17:03:48.701899 14 Options.info_log: 0x7f9d2084e370
|
||||||
|
2023/09/26-17:03:48.701900 14 Options.max_file_opening_threads: 16
|
||||||
|
2023/09/26-17:03:48.701900 14 Options.statistics: (nil)
|
||||||
|
2023/09/26-17:03:48.701901 14 Options.use_fsync: 0
|
||||||
|
2023/09/26-17:03:48.701902 14 Options.max_log_file_size: 0
|
||||||
|
2023/09/26-17:03:48.701903 14 Options.max_manifest_file_size: 1073741824
|
||||||
|
2023/09/26-17:03:48.701903 14 Options.log_file_time_to_roll: 0
|
||||||
|
2023/09/26-17:03:48.701904 14 Options.keep_log_file_num: 1000
|
||||||
|
2023/09/26-17:03:48.701905 14 Options.recycle_log_file_num: 0
|
||||||
|
2023/09/26-17:03:48.701905 14 Options.allow_fallocate: 1
|
||||||
|
2023/09/26-17:03:48.701906 14 Options.allow_mmap_reads: 0
|
||||||
|
2023/09/26-17:03:48.701907 14 Options.allow_mmap_writes: 0
|
||||||
|
2023/09/26-17:03:48.701907 14 Options.use_direct_reads: 0
|
||||||
|
2023/09/26-17:03:48.701908 14 Options.use_direct_io_for_flush_and_compaction: 0
|
||||||
|
2023/09/26-17:03:48.701909 14 Options.create_missing_column_families: 0
|
||||||
|
2023/09/26-17:03:48.701909 14 Options.db_log_dir:
|
||||||
|
2023/09/26-17:03:48.701910 14 Options.wal_dir:
|
||||||
|
2023/09/26-17:03:48.701911 14 Options.table_cache_numshardbits: 6
|
||||||
|
2023/09/26-17:03:48.701912 14 Options.WAL_ttl_seconds: 0
|
||||||
|
2023/09/26-17:03:48.701912 14 Options.WAL_size_limit_MB: 0
|
||||||
|
2023/09/26-17:03:48.701913 14 Options.max_write_batch_group_size_bytes: 1048576
|
||||||
|
2023/09/26-17:03:48.701914 14 Options.manifest_preallocation_size: 4194304
|
||||||
|
2023/09/26-17:03:48.701914 14 Options.is_fd_close_on_exec: 1
|
||||||
|
2023/09/26-17:03:48.701915 14 Options.advise_random_on_open: 1
|
||||||
|
2023/09/26-17:03:48.701916 14 Options.experimental_mempurge_threshold: 0.000000
|
||||||
|
2023/09/26-17:03:48.701917 14 Options.db_write_buffer_size: 0
|
||||||
|
2023/09/26-17:03:48.701918 14 Options.write_buffer_manager: 0x7f9d2080a280
|
||||||
|
2023/09/26-17:03:48.701919 14 Options.access_hint_on_compaction_start: 1
|
||||||
|
2023/09/26-17:03:48.701919 14 Options.new_table_reader_for_compaction_inputs: 0
|
||||||
|
2023/09/26-17:03:48.701920 14 Options.random_access_max_buffer_size: 1048576
|
||||||
|
2023/09/26-17:03:48.701921 14 Options.use_adaptive_mutex: 0
|
||||||
|
2023/09/26-17:03:48.701921 14 Options.rate_limiter: (nil)
|
||||||
|
2023/09/26-17:03:48.701922 14 Options.sst_file_manager.rate_bytes_per_sec: 0
|
||||||
|
2023/09/26-17:03:48.701923 14 Options.wal_recovery_mode: 2
|
||||||
|
2023/09/26-17:03:48.701927 14 Options.enable_thread_tracking: 0
|
||||||
|
2023/09/26-17:03:48.701927 14 Options.enable_pipelined_write: 0
|
||||||
|
2023/09/26-17:03:48.701928 14 Options.unordered_write: 0
|
||||||
|
2023/09/26-17:03:48.701929 14 Options.allow_concurrent_memtable_write: 1
|
||||||
|
2023/09/26-17:03:48.701929 14 Options.enable_write_thread_adaptive_yield: 1
|
||||||
|
2023/09/26-17:03:48.701930 14 Options.write_thread_max_yield_usec: 100
|
||||||
|
2023/09/26-17:03:48.701931 14 Options.write_thread_slow_yield_usec: 3
|
||||||
|
2023/09/26-17:03:48.701931 14 Options.row_cache: None
|
||||||
|
2023/09/26-17:03:48.701932 14 Options.wal_filter: None
|
||||||
|
2023/09/26-17:03:48.701933 14 Options.avoid_flush_during_recovery: 0
|
||||||
|
2023/09/26-17:03:48.701933 14 Options.allow_ingest_behind: 0
|
||||||
|
2023/09/26-17:03:48.701934 14 Options.preserve_deletes: 0
|
||||||
|
2023/09/26-17:03:48.701935 14 Options.two_write_queues: 0
|
||||||
|
2023/09/26-17:03:48.701935 14 Options.manual_wal_flush: 0
|
||||||
|
2023/09/26-17:03:48.701936 14 Options.atomic_flush: 0
|
||||||
|
2023/09/26-17:03:48.701937 14 Options.avoid_unnecessary_blocking_io: 0
|
||||||
|
2023/09/26-17:03:48.701937 14 Options.persist_stats_to_disk: 0
|
||||||
|
2023/09/26-17:03:48.701938 14 Options.write_dbid_to_manifest: 0
|
||||||
|
2023/09/26-17:03:48.701938 14 Options.log_readahead_size: 0
|
||||||
|
2023/09/26-17:03:48.701939 14 Options.file_checksum_gen_factory: Unknown
|
||||||
|
2023/09/26-17:03:48.701940 14 Options.best_efforts_recovery: 0
|
||||||
|
2023/09/26-17:03:48.701941 14 Options.max_bgerror_resume_count: 2147483647
|
||||||
|
2023/09/26-17:03:48.701942 14 Options.bgerror_resume_retry_interval: 1000000
|
||||||
|
2023/09/26-17:03:48.701942 14 Options.allow_data_in_errors: 0
|
||||||
|
2023/09/26-17:03:48.701943 14 Options.db_host_id: __hostname__
|
||||||
|
2023/09/26-17:03:48.701944 14 Options.max_background_jobs: 1
|
||||||
|
2023/09/26-17:03:48.701944 14 Options.max_background_compactions: -1
|
||||||
|
2023/09/26-17:03:48.701945 14 Options.max_subcompactions: 1
|
||||||
|
2023/09/26-17:03:48.701946 14 Options.avoid_flush_during_shutdown: 0
|
||||||
|
2023/09/26-17:03:48.701946 14 Options.writable_file_max_buffer_size: 1048576
|
||||||
|
2023/09/26-17:03:48.701947 14 Options.delayed_write_rate : 16777216
|
||||||
|
2023/09/26-17:03:48.701948 14 Options.max_total_wal_size: 0
|
||||||
|
2023/09/26-17:03:48.701948 14 Options.delete_obsolete_files_period_micros: 21600000000
|
||||||
|
2023/09/26-17:03:48.701949 14 Options.stats_dump_period_sec: 600
|
||||||
|
2023/09/26-17:03:48.701950 14 Options.stats_persist_period_sec: 600
|
||||||
|
2023/09/26-17:03:48.701950 14 Options.stats_history_buffer_size: 1048576
|
||||||
|
2023/09/26-17:03:48.701951 14 Options.max_open_files: -1
|
||||||
|
2023/09/26-17:03:48.701952 14 Options.bytes_per_sync: 0
|
||||||
|
2023/09/26-17:03:48.701952 14 Options.wal_bytes_per_sync: 0
|
||||||
|
2023/09/26-17:03:48.701953 14 Options.strict_bytes_per_sync: 0
|
||||||
|
2023/09/26-17:03:48.701954 14 Options.compaction_readahead_size: 0
|
||||||
|
2023/09/26-17:03:48.701954 14 Options.max_background_flushes: 1
|
||||||
|
2023/09/26-17:03:48.701955 14 Compression algorithms supported:
|
||||||
|
2023/09/26-17:03:48.701956 14 kZSTDNotFinalCompression supported: 1
|
||||||
|
2023/09/26-17:03:48.701957 14 kZSTD supported: 1
|
||||||
|
2023/09/26-17:03:48.701958 14 kXpressCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.701958 14 kLZ4HCCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.701959 14 kLZ4Compression supported: 0
|
||||||
|
2023/09/26-17:03:48.701960 14 kBZip2Compression supported: 0
|
||||||
|
2023/09/26-17:03:48.701960 14 kZlibCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.701961 14 kSnappyCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.701962 14 Fast CRC32 supported: Supported on x86
|
||||||
|
2023/09/26-17:03:48.702132 14 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data/MANIFEST-000016
|
||||||
|
2023/09/26-17:03:48.702202 14 [db/column_family.cc:605] --------------- Options for column family [default]:
|
||||||
|
2023/09/26-17:03:48.702204 14 Options.comparator: leveldb.BytewiseComparator
|
||||||
|
2023/09/26-17:03:48.702205 14 Options.merge_operator: None
|
||||||
|
2023/09/26-17:03:48.702205 14 Options.compaction_filter: None
|
||||||
|
2023/09/26-17:03:48.702206 14 Options.compaction_filter_factory: None
|
||||||
|
2023/09/26-17:03:48.702207 14 Options.sst_partitioner_factory: None
|
||||||
|
2023/09/26-17:03:48.702207 14 Options.memtable_factory: SkipListFactory
|
||||||
|
2023/09/26-17:03:48.702208 14 Options.table_factory: BlockBasedTable
|
||||||
|
2023/09/26-17:03:48.702222 14 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9d2089a560)
|
||||||
|
cache_index_and_filter_blocks: 0
|
||||||
|
cache_index_and_filter_blocks_with_high_priority: 1
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache: 0
|
||||||
|
pin_top_level_index_and_filter: 1
|
||||||
|
index_type: 0
|
||||||
|
data_block_index_type: 0
|
||||||
|
index_shortening: 1
|
||||||
|
data_block_hash_table_util_ratio: 0.750000
|
||||||
|
hash_index_allow_collision: 1
|
||||||
|
checksum: 1
|
||||||
|
no_block_cache: 0
|
||||||
|
block_cache: 0x7f9d2080a010
|
||||||
|
block_cache_name: LRUCache
|
||||||
|
block_cache_options:
|
||||||
|
capacity : 2502992855
|
||||||
|
num_shard_bits : 6
|
||||||
|
strict_capacity_limit : 0
|
||||||
|
memory_allocator : None
|
||||||
|
high_pri_pool_ratio: 0.500
|
||||||
|
block_cache_compressed: (nil)
|
||||||
|
persistent_cache: (nil)
|
||||||
|
block_size: 65536
|
||||||
|
block_size_deviation: 10
|
||||||
|
block_restart_interval: 16
|
||||||
|
index_block_restart_interval: 1
|
||||||
|
metadata_block_size: 4096
|
||||||
|
partition_filters: 0
|
||||||
|
use_delta_encoding: 1
|
||||||
|
filter_policy: nullptr
|
||||||
|
whole_key_filtering: 1
|
||||||
|
verify_compression: 0
|
||||||
|
read_amp_bytes_per_bit: 0
|
||||||
|
format_version: 5
|
||||||
|
enable_index_compression: 1
|
||||||
|
block_align: 0
|
||||||
|
max_auto_readahead_size: 262144
|
||||||
|
prepopulate_block_cache: 0
|
||||||
|
2023/09/26-17:03:48.702223 14 Options.write_buffer_size: 67108864
|
||||||
|
2023/09/26-17:03:48.702224 14 Options.max_write_buffer_number: 2
|
||||||
|
2023/09/26-17:03:48.702225 14 Options.compression[0]: NoCompression
|
||||||
|
2023/09/26-17:03:48.702226 14 Options.compression[1]: ZSTD
|
||||||
|
2023/09/26-17:03:48.702226 14 Options.compression[2]: ZSTD
|
||||||
|
2023/09/26-17:03:48.702227 14 Options.bottommost_compression: Disabled
|
||||||
|
2023/09/26-17:03:48.702228 14 Options.prefix_extractor: nullptr
|
||||||
|
2023/09/26-17:03:48.702228 14 Options.memtable_insert_with_hint_prefix_extractor: nullptr
|
||||||
|
2023/09/26-17:03:48.702229 14 Options.num_levels: 7
|
||||||
|
2023/09/26-17:03:48.702230 14 Options.min_write_buffer_number_to_merge: 1
|
||||||
|
2023/09/26-17:03:48.702230 14 Options.max_write_buffer_number_to_maintain: 0
|
||||||
|
2023/09/26-17:03:48.702231 14 Options.max_write_buffer_size_to_maintain: 0
|
||||||
|
2023/09/26-17:03:48.702232 14 Options.bottommost_compression_opts.window_bits: -14
|
||||||
|
2023/09/26-17:03:48.702232 14 Options.bottommost_compression_opts.level: 32767
|
||||||
|
2023/09/26-17:03:48.702233 14 Options.bottommost_compression_opts.strategy: 0
|
||||||
|
2023/09/26-17:03:48.702234 14 Options.bottommost_compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-17:03:48.702234 14 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-17:03:48.702235 14 Options.bottommost_compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-17:03:48.702236 14 Options.bottommost_compression_opts.enabled: false
|
||||||
|
2023/09/26-17:03:48.702236 14 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-17:03:48.702237 14 Options.compression_opts.window_bits: -14
|
||||||
|
2023/09/26-17:03:48.702238 14 Options.compression_opts.level: 32767
|
||||||
|
2023/09/26-17:03:48.702238 14 Options.compression_opts.strategy: 0
|
||||||
|
2023/09/26-17:03:48.702239 14 Options.compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-17:03:48.702240 14 Options.compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-17:03:48.702240 14 Options.compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-17:03:48.702241 14 Options.compression_opts.enabled: false
|
||||||
|
2023/09/26-17:03:48.702242 14 Options.compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-17:03:48.702245 14 Options.level0_file_num_compaction_trigger: 4
|
||||||
|
2023/09/26-17:03:48.702246 14 Options.level0_slowdown_writes_trigger: 20
|
||||||
|
2023/09/26-17:03:48.702247 14 Options.level0_stop_writes_trigger: 36
|
||||||
|
2023/09/26-17:03:48.702247 14 Options.target_file_size_base: 67108864
|
||||||
|
2023/09/26-17:03:48.702248 14 Options.target_file_size_multiplier: 2
|
||||||
|
2023/09/26-17:03:48.702249 14 Options.max_bytes_for_level_base: 268435456
|
||||||
|
2023/09/26-17:03:48.702250 14 Options.level_compaction_dynamic_level_bytes: 0
|
||||||
|
2023/09/26-17:03:48.702250 14 Options.max_bytes_for_level_multiplier: 10.000000
|
||||||
|
2023/09/26-17:03:48.702251 14 Options.max_bytes_for_level_multiplier_addtl[0]: 1
|
||||||
|
2023/09/26-17:03:48.702252 14 Options.max_bytes_for_level_multiplier_addtl[1]: 1
|
||||||
|
2023/09/26-17:03:48.702253 14 Options.max_bytes_for_level_multiplier_addtl[2]: 1
|
||||||
|
2023/09/26-17:03:48.702254 14 Options.max_bytes_for_level_multiplier_addtl[3]: 1
|
||||||
|
2023/09/26-17:03:48.702254 14 Options.max_bytes_for_level_multiplier_addtl[4]: 1
|
||||||
|
2023/09/26-17:03:48.702255 14 Options.max_bytes_for_level_multiplier_addtl[5]: 1
|
||||||
|
2023/09/26-17:03:48.702256 14 Options.max_bytes_for_level_multiplier_addtl[6]: 1
|
||||||
|
2023/09/26-17:03:48.702256 14 Options.max_sequential_skip_in_iterations: 8
|
||||||
|
2023/09/26-17:03:48.702257 14 Options.max_compaction_bytes: 1677721600
|
||||||
|
2023/09/26-17:03:48.702258 14 Options.arena_block_size: 1048576
|
||||||
|
2023/09/26-17:03:48.702258 14 Options.soft_pending_compaction_bytes_limit: 68719476736
|
||||||
|
2023/09/26-17:03:48.702259 14 Options.hard_pending_compaction_bytes_limit: 274877906944
|
||||||
|
2023/09/26-17:03:48.702260 14 Options.rate_limit_delay_max_milliseconds: 100
|
||||||
|
2023/09/26-17:03:48.702260 14 Options.disable_auto_compactions: 0
|
||||||
|
2023/09/26-17:03:48.702261 14 Options.compaction_style: kCompactionStyleLevel
|
||||||
|
2023/09/26-17:03:48.702262 14 Options.compaction_pri: kMinOverlappingRatio
|
||||||
|
2023/09/26-17:03:48.702263 14 Options.compaction_options_universal.size_ratio: 1
|
||||||
|
2023/09/26-17:03:48.702264 14 Options.compaction_options_universal.min_merge_width: 2
|
||||||
|
2023/09/26-17:03:48.702264 14 Options.compaction_options_universal.max_merge_width: 4294967295
|
||||||
|
2023/09/26-17:03:48.702265 14 Options.compaction_options_universal.max_size_amplification_percent: 200
|
||||||
|
2023/09/26-17:03:48.702266 14 Options.compaction_options_universal.compression_size_percent: -1
|
||||||
|
2023/09/26-17:03:48.702266 14 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
|
||||||
|
2023/09/26-17:03:48.702267 14 Options.compaction_options_fifo.max_table_files_size: 1073741824
|
||||||
|
2023/09/26-17:03:48.702268 14 Options.compaction_options_fifo.allow_compaction: 0
|
||||||
|
2023/09/26-17:03:48.702271 14 Options.table_properties_collectors:
|
||||||
|
2023/09/26-17:03:48.702272 14 Options.inplace_update_support: 0
|
||||||
|
2023/09/26-17:03:48.702273 14 Options.inplace_update_num_locks: 10000
|
||||||
|
2023/09/26-17:03:48.702273 14 Options.memtable_prefix_bloom_size_ratio: 0.000000
|
||||||
|
2023/09/26-17:03:48.702274 14 Options.memtable_whole_key_filtering: 0
|
||||||
|
2023/09/26-17:03:48.702275 14 Options.memtable_huge_page_size: 0
|
||||||
|
2023/09/26-17:03:48.702276 14 Options.bloom_locality: 0
|
||||||
|
2023/09/26-17:03:48.702276 14 Options.max_successive_merges: 0
|
||||||
|
2023/09/26-17:03:48.702277 14 Options.optimize_filters_for_hits: 0
|
||||||
|
2023/09/26-17:03:48.702278 14 Options.paranoid_file_checks: 0
|
||||||
|
2023/09/26-17:03:48.702278 14 Options.force_consistency_checks: 1
|
||||||
|
2023/09/26-17:03:48.702279 14 Options.report_bg_io_stats: 0
|
||||||
|
2023/09/26-17:03:48.702279 14 Options.ttl: 2592000
|
||||||
|
2023/09/26-17:03:48.702280 14 Options.periodic_compaction_seconds: 0
|
||||||
|
2023/09/26-17:03:48.702281 14 Options.enable_blob_files: false
|
||||||
|
2023/09/26-17:03:48.702284 14 Options.min_blob_size: 0
|
||||||
|
2023/09/26-17:03:48.702284 14 Options.blob_file_size: 268435456
|
||||||
|
2023/09/26-17:03:48.702285 14 Options.blob_compression_type: NoCompression
|
||||||
|
2023/09/26-17:03:48.702286 14 Options.enable_blob_garbage_collection: false
|
||||||
|
2023/09/26-17:03:48.702286 14 Options.blob_garbage_collection_age_cutoff: 0.250000
|
||||||
|
2023/09/26-17:03:48.702287 14 Options.blob_garbage_collection_force_threshold: 1.000000
|
||||||
|
2023/09/26-17:03:48.702288 14 Options.blob_compaction_readahead_size: 0
|
||||||
|
2023/09/26-17:03:48.703175 14 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data/MANIFEST-000016 succeeded,manifest_file_number is 16, next_file_number is 18, last_sequence is 72527, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
|
||||||
|
2023/09/26-17:03:48.703178 14 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 12
|
||||||
|
2023/09/26-17:03:48.703355 14 [db/version_set.cc:4384] Creating manifest 20
|
||||||
|
2023/09/26-17:03:48.707321 14 EVENT_LOG_v1 {"time_micros": 1695747828707319, "job": 1, "event": "recovery_started", "wal_files": [17]}
|
||||||
|
2023/09/26-17:03:48.707324 14 [db/db_impl/db_impl_open.cc:883] Recovering log #17 mode 2
|
||||||
|
2023/09/26-17:03:48.779335 14 EVENT_LOG_v1 {"time_micros": 1695747828779316, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 21, "file_size": 19283516, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 19280595, "index_size": 1992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 2492118, "raw_average_key_size": 51, "raw_value_size": 18544810, "raw_average_value_size": 384, "num_data_blocks": 35, "num_entries": 48227, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695747828, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d", "db_session_id": "345C9WGIGWXHNGD85BUN", "orig_file_number": 21}}
|
||||||
|
2023/09/26-17:03:48.779724 14 [db/version_set.cc:4384] Creating manifest 22
|
||||||
|
2023/09/26-17:03:48.783883 14 EVENT_LOG_v1 {"time_micros": 1695747828783880, "job": 1, "event": "recovery_finished"}
|
||||||
|
2023/09/26-17:03:48.788207 14 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data/000017.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
|
||||||
|
2023/09/26-17:03:48.788228 14 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9d20855380
|
||||||
|
2023/09/26-17:03:48.788248 14 DB pointer 0x7f9d2083ac00
|
||||||
|
2023/09/26-17:03:51.788542 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:03:51.788578 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3.1 total, 3.1 interval
|
||||||
|
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3.1 total, 3.1 interval
|
||||||
|
Flush(GB): cumulative 0.018, interval 0.018
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.02 GB write, 5.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.02 GB write, 5.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 1 last_copies: 1 last_secs: 2.9e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-17:13:51.788904 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:13:51.788979 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 603.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 7052 writes, 7052 keys, 7052 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.03 MB/s
|
||||||
|
Cumulative WAL: 7052 writes, 0 syncs, 7052.00 writes per sync, written: 0.02 GB, 0.03 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7052 writes, 7052 keys, 7052 commit groups, 1.0 writes per commit group, ingest: 17.05 MB, 0.03 MB/s
|
||||||
|
Interval WAL: 7052 writes, 0 syncs, 7052.00 writes per sync, written: 0.02 GB, 0.03 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 603.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.018, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.02 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 2 last_copies: 1 last_secs: 9.2e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-17:23:51.789136 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:23:51.789167 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1203.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 14K writes, 0 syncs, 14252.00 writes per sync, written: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1203.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.018, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.02 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 3 last_copies: 1 last_secs: 9e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-17:33:51.789461 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:33:51.789532 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1803.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 21K writes, 0 syncs, 21452.00 writes per sync, written: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1803.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.018, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.02 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 4 last_copies: 1 last_secs: 0.000227 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
|
@ -0,0 +1,815 @@
|
||||||
|
2023/09/26-09:25:26.699470 17 RocksDB version: 6.27.3
|
||||||
|
2023/09/26-09:25:26.699496 17 Git sha 0
|
||||||
|
2023/09/26-09:25:26.699497 17 Compile date 2023-06-14 04:09:40
|
||||||
|
2023/09/26-09:25:26.699500 17 DB SUMMARY
|
||||||
|
2023/09/26-09:25:26.699501 17 DB Session ID: 6O2QNLLK9Q04IJ9PYGWU
|
||||||
|
2023/09/26-09:25:26.699516 17 CURRENT file: CURRENT
|
||||||
|
2023/09/26-09:25:26.699518 17 IDENTITY file: IDENTITY
|
||||||
|
2023/09/26-09:25:26.699522 17 MANIFEST file: MANIFEST-000004 size: 57 Bytes
|
||||||
|
2023/09/26-09:25:26.699523 17 SST files in /var/lib/milvus/rdb_data dir, Total Num: 0, files:
|
||||||
|
2023/09/26-09:25:26.699525 17 Write Ahead Log file in /var/lib/milvus/rdb_data: 000005.log size: 11594 ;
|
||||||
|
2023/09/26-09:25:26.699526 17 Options.error_if_exists: 0
|
||||||
|
2023/09/26-09:25:26.699527 17 Options.create_if_missing: 1
|
||||||
|
2023/09/26-09:25:26.699529 17 Options.paranoid_checks: 1
|
||||||
|
2023/09/26-09:25:26.699530 17 Options.flush_verify_memtable_count: 1
|
||||||
|
2023/09/26-09:25:26.699531 17 Options.track_and_verify_wals_in_manifest: 0
|
||||||
|
2023/09/26-09:25:26.699532 17 Options.env: 0x5e1d140
|
||||||
|
2023/09/26-09:25:26.699533 17 Options.fs: PosixFileSystem
|
||||||
|
2023/09/26-09:25:26.699534 17 Options.info_log: 0x7f9133a1a3c0
|
||||||
|
2023/09/26-09:25:26.699535 17 Options.max_file_opening_threads: 16
|
||||||
|
2023/09/26-09:25:26.699536 17 Options.statistics: (nil)
|
||||||
|
2023/09/26-09:25:26.699538 17 Options.use_fsync: 0
|
||||||
|
2023/09/26-09:25:26.699539 17 Options.max_log_file_size: 0
|
||||||
|
2023/09/26-09:25:26.699540 17 Options.max_manifest_file_size: 1073741824
|
||||||
|
2023/09/26-09:25:26.699541 17 Options.log_file_time_to_roll: 0
|
||||||
|
2023/09/26-09:25:26.699542 17 Options.keep_log_file_num: 1000
|
||||||
|
2023/09/26-09:25:26.699543 17 Options.recycle_log_file_num: 0
|
||||||
|
2023/09/26-09:25:26.699544 17 Options.allow_fallocate: 1
|
||||||
|
2023/09/26-09:25:26.699545 17 Options.allow_mmap_reads: 0
|
||||||
|
2023/09/26-09:25:26.699546 17 Options.allow_mmap_writes: 0
|
||||||
|
2023/09/26-09:25:26.699547 17 Options.use_direct_reads: 0
|
||||||
|
2023/09/26-09:25:26.699548 17 Options.use_direct_io_for_flush_and_compaction: 0
|
||||||
|
2023/09/26-09:25:26.699550 17 Options.create_missing_column_families: 0
|
||||||
|
2023/09/26-09:25:26.699550 17 Options.db_log_dir:
|
||||||
|
2023/09/26-09:25:26.699552 17 Options.wal_dir:
|
||||||
|
2023/09/26-09:25:26.699553 17 Options.table_cache_numshardbits: 6
|
||||||
|
2023/09/26-09:25:26.699554 17 Options.WAL_ttl_seconds: 0
|
||||||
|
2023/09/26-09:25:26.699555 17 Options.WAL_size_limit_MB: 0
|
||||||
|
2023/09/26-09:25:26.699555 17 Options.max_write_batch_group_size_bytes: 1048576
|
||||||
|
2023/09/26-09:25:26.699557 17 Options.manifest_preallocation_size: 4194304
|
||||||
|
2023/09/26-09:25:26.699558 17 Options.is_fd_close_on_exec: 1
|
||||||
|
2023/09/26-09:25:26.699559 17 Options.advise_random_on_open: 1
|
||||||
|
2023/09/26-09:25:26.699560 17 Options.experimental_mempurge_threshold: 0.000000
|
||||||
|
2023/09/26-09:25:26.699562 17 Options.db_write_buffer_size: 0
|
||||||
|
2023/09/26-09:25:26.699563 17 Options.write_buffer_manager: 0x7f9133a25280
|
||||||
|
2023/09/26-09:25:26.699564 17 Options.access_hint_on_compaction_start: 1
|
||||||
|
2023/09/26-09:25:26.699565 17 Options.new_table_reader_for_compaction_inputs: 0
|
||||||
|
2023/09/26-09:25:26.699566 17 Options.random_access_max_buffer_size: 1048576
|
||||||
|
2023/09/26-09:25:26.699567 17 Options.use_adaptive_mutex: 0
|
||||||
|
2023/09/26-09:25:26.699568 17 Options.rate_limiter: (nil)
|
||||||
|
2023/09/26-09:25:26.699570 17 Options.sst_file_manager.rate_bytes_per_sec: 0
|
||||||
|
2023/09/26-09:25:26.699571 17 Options.wal_recovery_mode: 2
|
||||||
|
2023/09/26-09:25:26.699572 17 Options.enable_thread_tracking: 0
|
||||||
|
2023/09/26-09:25:26.699579 17 Options.enable_pipelined_write: 0
|
||||||
|
2023/09/26-09:25:26.699580 17 Options.unordered_write: 0
|
||||||
|
2023/09/26-09:25:26.699582 17 Options.allow_concurrent_memtable_write: 1
|
||||||
|
2023/09/26-09:25:26.699583 17 Options.enable_write_thread_adaptive_yield: 1
|
||||||
|
2023/09/26-09:25:26.699584 17 Options.write_thread_max_yield_usec: 100
|
||||||
|
2023/09/26-09:25:26.699585 17 Options.write_thread_slow_yield_usec: 3
|
||||||
|
2023/09/26-09:25:26.699586 17 Options.row_cache: None
|
||||||
|
2023/09/26-09:25:26.699587 17 Options.wal_filter: None
|
||||||
|
2023/09/26-09:25:26.699589 17 Options.avoid_flush_during_recovery: 0
|
||||||
|
2023/09/26-09:25:26.699590 17 Options.allow_ingest_behind: 0
|
||||||
|
2023/09/26-09:25:26.699591 17 Options.preserve_deletes: 0
|
||||||
|
2023/09/26-09:25:26.699592 17 Options.two_write_queues: 0
|
||||||
|
2023/09/26-09:25:26.699593 17 Options.manual_wal_flush: 0
|
||||||
|
2023/09/26-09:25:26.699594 17 Options.atomic_flush: 0
|
||||||
|
2023/09/26-09:25:26.699595 17 Options.avoid_unnecessary_blocking_io: 0
|
||||||
|
2023/09/26-09:25:26.699596 17 Options.persist_stats_to_disk: 0
|
||||||
|
2023/09/26-09:25:26.699597 17 Options.write_dbid_to_manifest: 0
|
||||||
|
2023/09/26-09:25:26.699598 17 Options.log_readahead_size: 0
|
||||||
|
2023/09/26-09:25:26.699599 17 Options.file_checksum_gen_factory: Unknown
|
||||||
|
2023/09/26-09:25:26.699600 17 Options.best_efforts_recovery: 0
|
||||||
|
2023/09/26-09:25:26.699601 17 Options.max_bgerror_resume_count: 2147483647
|
||||||
|
2023/09/26-09:25:26.699602 17 Options.bgerror_resume_retry_interval: 1000000
|
||||||
|
2023/09/26-09:25:26.699604 17 Options.allow_data_in_errors: 0
|
||||||
|
2023/09/26-09:25:26.699605 17 Options.db_host_id: __hostname__
|
||||||
|
2023/09/26-09:25:26.699606 17 Options.max_background_jobs: 1
|
||||||
|
2023/09/26-09:25:26.699607 17 Options.max_background_compactions: -1
|
||||||
|
2023/09/26-09:25:26.699608 17 Options.max_subcompactions: 1
|
||||||
|
2023/09/26-09:25:26.699609 17 Options.avoid_flush_during_shutdown: 0
|
||||||
|
2023/09/26-09:25:26.699610 17 Options.writable_file_max_buffer_size: 1048576
|
||||||
|
2023/09/26-09:25:26.699611 17 Options.delayed_write_rate : 16777216
|
||||||
|
2023/09/26-09:25:26.699612 17 Options.max_total_wal_size: 0
|
||||||
|
2023/09/26-09:25:26.699613 17 Options.delete_obsolete_files_period_micros: 21600000000
|
||||||
|
2023/09/26-09:25:26.699615 17 Options.stats_dump_period_sec: 600
|
||||||
|
2023/09/26-09:25:26.699616 17 Options.stats_persist_period_sec: 600
|
||||||
|
2023/09/26-09:25:26.699617 17 Options.stats_history_buffer_size: 1048576
|
||||||
|
2023/09/26-09:25:26.699618 17 Options.max_open_files: -1
|
||||||
|
2023/09/26-09:25:26.699619 17 Options.bytes_per_sync: 0
|
||||||
|
2023/09/26-09:25:26.699620 17 Options.wal_bytes_per_sync: 0
|
||||||
|
2023/09/26-09:25:26.699621 17 Options.strict_bytes_per_sync: 0
|
||||||
|
2023/09/26-09:25:26.699622 17 Options.compaction_readahead_size: 0
|
||||||
|
2023/09/26-09:25:26.699623 17 Options.max_background_flushes: 1
|
||||||
|
2023/09/26-09:25:26.699624 17 Compression algorithms supported:
|
||||||
|
2023/09/26-09:25:26.699626 17 kZSTDNotFinalCompression supported: 1
|
||||||
|
2023/09/26-09:25:26.699627 17 kZSTD supported: 1
|
||||||
|
2023/09/26-09:25:26.699628 17 kXpressCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.699629 17 kLZ4HCCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.699630 17 kLZ4Compression supported: 0
|
||||||
|
2023/09/26-09:25:26.699631 17 kBZip2Compression supported: 0
|
||||||
|
2023/09/26-09:25:26.699632 17 kZlibCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.699634 17 kSnappyCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.699635 17 Fast CRC32 supported: Supported on x86
|
||||||
|
2023/09/26-09:25:26.699679 17 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data/MANIFEST-000004
|
||||||
|
2023/09/26-09:25:26.699782 17 [db/column_family.cc:605] --------------- Options for column family [default]:
|
||||||
|
2023/09/26-09:25:26.699789 17 Options.comparator: leveldb.BytewiseComparator
|
||||||
|
2023/09/26-09:25:26.699791 17 Options.merge_operator: None
|
||||||
|
2023/09/26-09:25:26.699792 17 Options.compaction_filter: None
|
||||||
|
2023/09/26-09:25:26.699793 17 Options.compaction_filter_factory: None
|
||||||
|
2023/09/26-09:25:26.699795 17 Options.sst_partitioner_factory: None
|
||||||
|
2023/09/26-09:25:26.699796 17 Options.memtable_factory: SkipListFactory
|
||||||
|
2023/09/26-09:25:26.699797 17 Options.table_factory: BlockBasedTable
|
||||||
|
2023/09/26-09:25:26.699820 17 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9133a146c0)
|
||||||
|
cache_index_and_filter_blocks: 0
|
||||||
|
cache_index_and_filter_blocks_with_high_priority: 1
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache: 0
|
||||||
|
pin_top_level_index_and_filter: 1
|
||||||
|
index_type: 0
|
||||||
|
data_block_index_type: 0
|
||||||
|
index_shortening: 1
|
||||||
|
data_block_hash_table_util_ratio: 0.750000
|
||||||
|
hash_index_allow_collision: 1
|
||||||
|
checksum: 1
|
||||||
|
no_block_cache: 0
|
||||||
|
block_cache: 0x7f9133a25010
|
||||||
|
block_cache_name: LRUCache
|
||||||
|
block_cache_options:
|
||||||
|
capacity : 2502992855
|
||||||
|
num_shard_bits : 6
|
||||||
|
strict_capacity_limit : 0
|
||||||
|
memory_allocator : None
|
||||||
|
high_pri_pool_ratio: 0.500
|
||||||
|
block_cache_compressed: (nil)
|
||||||
|
persistent_cache: (nil)
|
||||||
|
block_size: 65536
|
||||||
|
block_size_deviation: 10
|
||||||
|
block_restart_interval: 16
|
||||||
|
index_block_restart_interval: 1
|
||||||
|
metadata_block_size: 4096
|
||||||
|
partition_filters: 0
|
||||||
|
use_delta_encoding: 1
|
||||||
|
filter_policy: nullptr
|
||||||
|
whole_key_filtering: 1
|
||||||
|
verify_compression: 0
|
||||||
|
read_amp_bytes_per_bit: 0
|
||||||
|
format_version: 5
|
||||||
|
enable_index_compression: 1
|
||||||
|
block_align: 0
|
||||||
|
max_auto_readahead_size: 262144
|
||||||
|
prepopulate_block_cache: 0
|
||||||
|
2023/09/26-09:25:26.699824 17 Options.write_buffer_size: 67108864
|
||||||
|
2023/09/26-09:25:26.699825 17 Options.max_write_buffer_number: 2
|
||||||
|
2023/09/26-09:25:26.699827 17 Options.compression[0]: NoCompression
|
||||||
|
2023/09/26-09:25:26.699829 17 Options.compression[1]: ZSTD
|
||||||
|
2023/09/26-09:25:26.699831 17 Options.compression[2]: ZSTD
|
||||||
|
2023/09/26-09:25:26.699832 17 Options.bottommost_compression: Disabled
|
||||||
|
2023/09/26-09:25:26.699833 17 Options.prefix_extractor: nullptr
|
||||||
|
2023/09/26-09:25:26.699835 17 Options.memtable_insert_with_hint_prefix_extractor: nullptr
|
||||||
|
2023/09/26-09:25:26.699836 17 Options.num_levels: 7
|
||||||
|
2023/09/26-09:25:26.699837 17 Options.min_write_buffer_number_to_merge: 1
|
||||||
|
2023/09/26-09:25:26.699838 17 Options.max_write_buffer_number_to_maintain: 0
|
||||||
|
2023/09/26-09:25:26.699840 17 Options.max_write_buffer_size_to_maintain: 0
|
||||||
|
2023/09/26-09:25:26.699841 17 Options.bottommost_compression_opts.window_bits: -14
|
||||||
|
2023/09/26-09:25:26.699843 17 Options.bottommost_compression_opts.level: 32767
|
||||||
|
2023/09/26-09:25:26.699844 17 Options.bottommost_compression_opts.strategy: 0
|
||||||
|
2023/09/26-09:25:26.699846 17 Options.bottommost_compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-09:25:26.699847 17 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-09:25:26.699848 17 Options.bottommost_compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-09:25:26.699850 17 Options.bottommost_compression_opts.enabled: false
|
||||||
|
2023/09/26-09:25:26.699851 17 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-09:25:26.699852 17 Options.compression_opts.window_bits: -14
|
||||||
|
2023/09/26-09:25:26.699853 17 Options.compression_opts.level: 32767
|
||||||
|
2023/09/26-09:25:26.699855 17 Options.compression_opts.strategy: 0
|
||||||
|
2023/09/26-09:25:26.699856 17 Options.compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-09:25:26.699857 17 Options.compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-09:25:26.699858 17 Options.compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-09:25:26.699859 17 Options.compression_opts.enabled: false
|
||||||
|
2023/09/26-09:25:26.699861 17 Options.compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-09:25:26.699866 17 Options.level0_file_num_compaction_trigger: 4
|
||||||
|
2023/09/26-09:25:26.699867 17 Options.level0_slowdown_writes_trigger: 20
|
||||||
|
2023/09/26-09:25:26.699868 17 Options.level0_stop_writes_trigger: 36
|
||||||
|
2023/09/26-09:25:26.699870 17 Options.target_file_size_base: 67108864
|
||||||
|
2023/09/26-09:25:26.699871 17 Options.target_file_size_multiplier: 2
|
||||||
|
2023/09/26-09:25:26.699872 17 Options.max_bytes_for_level_base: 268435456
|
||||||
|
2023/09/26-09:25:26.699873 17 Options.level_compaction_dynamic_level_bytes: 0
|
||||||
|
2023/09/26-09:25:26.699874 17 Options.max_bytes_for_level_multiplier: 10.000000
|
||||||
|
2023/09/26-09:25:26.699876 17 Options.max_bytes_for_level_multiplier_addtl[0]: 1
|
||||||
|
2023/09/26-09:25:26.699878 17 Options.max_bytes_for_level_multiplier_addtl[1]: 1
|
||||||
|
2023/09/26-09:25:26.699879 17 Options.max_bytes_for_level_multiplier_addtl[2]: 1
|
||||||
|
2023/09/26-09:25:26.699881 17 Options.max_bytes_for_level_multiplier_addtl[3]: 1
|
||||||
|
2023/09/26-09:25:26.699882 17 Options.max_bytes_for_level_multiplier_addtl[4]: 1
|
||||||
|
2023/09/26-09:25:26.699883 17 Options.max_bytes_for_level_multiplier_addtl[5]: 1
|
||||||
|
2023/09/26-09:25:26.699884 17 Options.max_bytes_for_level_multiplier_addtl[6]: 1
|
||||||
|
2023/09/26-09:25:26.699886 17 Options.max_sequential_skip_in_iterations: 8
|
||||||
|
2023/09/26-09:25:26.699887 17 Options.max_compaction_bytes: 1677721600
|
||||||
|
2023/09/26-09:25:26.699888 17 Options.arena_block_size: 1048576
|
||||||
|
2023/09/26-09:25:26.699889 17 Options.soft_pending_compaction_bytes_limit: 68719476736
|
||||||
|
2023/09/26-09:25:26.699891 17 Options.hard_pending_compaction_bytes_limit: 274877906944
|
||||||
|
2023/09/26-09:25:26.699892 17 Options.rate_limit_delay_max_milliseconds: 100
|
||||||
|
2023/09/26-09:25:26.699893 17 Options.disable_auto_compactions: 0
|
||||||
|
2023/09/26-09:25:26.699895 17 Options.compaction_style: kCompactionStyleLevel
|
||||||
|
2023/09/26-09:25:26.699897 17 Options.compaction_pri: kMinOverlappingRatio
|
||||||
|
2023/09/26-09:25:26.699898 17 Options.compaction_options_universal.size_ratio: 1
|
||||||
|
2023/09/26-09:25:26.699899 17 Options.compaction_options_universal.min_merge_width: 2
|
||||||
|
2023/09/26-09:25:26.699900 17 Options.compaction_options_universal.max_merge_width: 4294967295
|
||||||
|
2023/09/26-09:25:26.699901 17 Options.compaction_options_universal.max_size_amplification_percent: 200
|
||||||
|
2023/09/26-09:25:26.699902 17 Options.compaction_options_universal.compression_size_percent: -1
|
||||||
|
2023/09/26-09:25:26.699904 17 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
|
||||||
|
2023/09/26-09:25:26.699905 17 Options.compaction_options_fifo.max_table_files_size: 1073741824
|
||||||
|
2023/09/26-09:25:26.699906 17 Options.compaction_options_fifo.allow_compaction: 0
|
||||||
|
2023/09/26-09:25:26.699910 17 Options.table_properties_collectors:
|
||||||
|
2023/09/26-09:25:26.699911 17 Options.inplace_update_support: 0
|
||||||
|
2023/09/26-09:25:26.699912 17 Options.inplace_update_num_locks: 10000
|
||||||
|
2023/09/26-09:25:26.699913 17 Options.memtable_prefix_bloom_size_ratio: 0.000000
|
||||||
|
2023/09/26-09:25:26.699915 17 Options.memtable_whole_key_filtering: 0
|
||||||
|
2023/09/26-09:25:26.699916 17 Options.memtable_huge_page_size: 0
|
||||||
|
2023/09/26-09:25:26.699917 17 Options.bloom_locality: 0
|
||||||
|
2023/09/26-09:25:26.699918 17 Options.max_successive_merges: 0
|
||||||
|
2023/09/26-09:25:26.699919 17 Options.optimize_filters_for_hits: 0
|
||||||
|
2023/09/26-09:25:26.699920 17 Options.paranoid_file_checks: 0
|
||||||
|
2023/09/26-09:25:26.699922 17 Options.force_consistency_checks: 1
|
||||||
|
2023/09/26-09:25:26.699923 17 Options.report_bg_io_stats: 0
|
||||||
|
2023/09/26-09:25:26.699924 17 Options.ttl: 2592000
|
||||||
|
2023/09/26-09:25:26.699925 17 Options.periodic_compaction_seconds: 0
|
||||||
|
2023/09/26-09:25:26.699926 17 Options.enable_blob_files: false
|
||||||
|
2023/09/26-09:25:26.699927 17 Options.min_blob_size: 0
|
||||||
|
2023/09/26-09:25:26.699932 17 Options.blob_file_size: 268435456
|
||||||
|
2023/09/26-09:25:26.699933 17 Options.blob_compression_type: NoCompression
|
||||||
|
2023/09/26-09:25:26.699934 17 Options.enable_blob_garbage_collection: false
|
||||||
|
2023/09/26-09:25:26.699935 17 Options.blob_garbage_collection_age_cutoff: 0.250000
|
||||||
|
2023/09/26-09:25:26.699937 17 Options.blob_garbage_collection_force_threshold: 1.000000
|
||||||
|
2023/09/26-09:25:26.699939 17 Options.blob_compaction_readahead_size: 0
|
||||||
|
2023/09/26-09:25:26.700713 17 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data/MANIFEST-000004 succeeded,manifest_file_number is 4, next_file_number is 6, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
|
||||||
|
2023/09/26-09:25:26.700718 17 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 0
|
||||||
|
2023/09/26-09:25:26.700760 17 [db/version_set.cc:4384] Creating manifest 8
|
||||||
|
2023/09/26-09:25:26.704699 17 EVENT_LOG_v1 {"time_micros": 1695720326704696, "job": 1, "event": "recovery_started", "wal_files": [5]}
|
||||||
|
2023/09/26-09:25:26.704702 17 [db/db_impl/db_impl_open.cc:883] Recovering log #5 mode 2
|
||||||
|
2023/09/26-09:25:26.706160 17 EVENT_LOG_v1 {"time_micros": 1695720326706147, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 9, "file_size": 6408, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 5431, "index_size": 59, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 6396, "raw_average_key_size": 51, "raw_value_size": 3461, "raw_average_value_size": 27, "num_data_blocks": 1, "num_entries": 124, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695720326, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d", "db_session_id": "6O2QNLLK9Q04IJ9PYGWU", "orig_file_number": 9}}
|
||||||
|
2023/09/26-09:25:26.706181 17 [db/version_set.cc:4384] Creating manifest 10
|
||||||
|
2023/09/26-09:25:26.710205 17 EVENT_LOG_v1 {"time_micros": 1695720326710202, "job": 1, "event": "recovery_finished"}
|
||||||
|
2023/09/26-09:25:26.713610 17 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data/000005.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
|
||||||
|
2023/09/26-09:25:26.713628 17 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9133a5b380
|
||||||
|
2023/09/26-09:25:26.713653 17 DB pointer 0x7f9133a47c00
|
||||||
|
2023/09/26-09:25:29.713819 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:25:29.713835 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3.0 total, 3.0 interval
|
||||||
|
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3.0 total, 3.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 1 last_copies: 1 last_secs: 3.4e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-09:35:29.714154 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:35:29.714224 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 603.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 4281 writes, 4281 keys, 4280 commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.06 MB/s
|
||||||
|
Cumulative WAL: 4281 writes, 0 syncs, 4281.00 writes per sync, written: 0.03 GB, 0.06 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 4281 writes, 4281 keys, 4280 commit groups, 1.0 writes per commit group, ingest: 33.28 MB, 0.06 MB/s
|
||||||
|
Interval WAL: 4281 writes, 0 syncs, 4281.00 writes per sync, written: 0.03 GB, 0.06 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 603.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 2 last_copies: 1 last_secs: 4.2e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-09:45:29.714631 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:45:29.714730 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1203.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 11K writes, 11K keys, 11K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.03 MB/s
|
||||||
|
Cumulative WAL: 11K writes, 0 syncs, 11476.00 writes per sync, written: 0.03 GB, 0.03 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7195 writes, 7195 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7195 writes, 0 syncs, 7195.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1203.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 3 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-09:55:29.714886 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:55:29.714915 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1803.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 18K writes, 18K keys, 18K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.02 MB/s
|
||||||
|
Cumulative WAL: 18K writes, 0 syncs, 18674.00 writes per sync, written: 0.03 GB, 0.02 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7198 writes, 7198 keys, 7196 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1803.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 4 last_copies: 1 last_secs: 3.5e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:05:29.715058 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:05:29.715081 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 2403.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 25K writes, 25K keys, 25K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 25K writes, 0 syncs, 25870.00 writes per sync, written: 0.03 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7196 writes, 7196 keys, 7196 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7196 writes, 0 syncs, 7196.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 2403.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 5 last_copies: 1 last_secs: 3.4e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:15:29.715395 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:15:29.715471 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3003.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 33K writes, 33K keys, 33K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 33K writes, 0 syncs, 33069.00 writes per sync, written: 0.03 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7199 writes, 7199 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3003.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 6 last_copies: 1 last_secs: 9.2e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:25:29.715681 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:25:29.715727 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3603.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 40K writes, 40K keys, 40K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 40K writes, 0 syncs, 40269.00 writes per sync, written: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7197 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3603.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 7 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:35:29.716030 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:35:29.716104 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 4203.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 47K writes, 47K keys, 47K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 47K writes, 0 syncs, 47468.00 writes per sync, written: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7199 writes, 7199 keys, 7197 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 4203.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 8 last_copies: 1 last_secs: 8.9e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:45:29.716385 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:45:29.716449 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 4803.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 54K writes, 54K keys, 54K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 54K writes, 0 syncs, 54666.00 writes per sync, written: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7198 writes, 7198 keys, 7194 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 4803.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 9 last_copies: 1 last_secs: 9e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:55:29.716744 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:55:29.716813 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 5403.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 61K writes, 61K keys, 61K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 61K writes, 0 syncs, 61866.00 writes per sync, written: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 5403.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 10 last_copies: 1 last_secs: 4.3e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:05:29.716970 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:05:29.717010 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 6003.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 69K writes, 69K keys, 69K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 69K writes, 0 syncs, 69066.00 writes per sync, written: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7197 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 6003.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 11 last_copies: 1 last_secs: 8.9e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:15:29.717259 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:15:29.717315 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 6603.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 3337 writes, 3337 keys, 3336 commit groups, 1.0 writes per commit group, ingest: 0.27 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 3337 writes, 0 syncs, 3337.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 6603.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 12 last_copies: 1 last_secs: 3.6e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:25:29.717620 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:25:29.717693 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 7203.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 7203.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 13 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:35:29.717997 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:35:29.718068 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 7803.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 7803.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 14 last_copies: 1 last_secs: 7.7e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:45:29.718233 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:45:29.718281 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 8403.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 8403.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 15 last_copies: 1 last_secs: 9.6e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:54:32.182329 7 [db/db_impl/db_impl.cc:472] Shutdown: canceling all background work
|
||||||
|
2023/09/26-11:54:32.182528 7 [db/db_impl/db_impl.cc:685] Shutdown complete
|
|
@ -0,0 +1,509 @@
|
||||||
|
2023/09/26-11:55:44.081185 16 RocksDB version: 6.27.3
|
||||||
|
2023/09/26-11:55:44.081207 16 Git sha 0
|
||||||
|
2023/09/26-11:55:44.081211 16 Compile date 2023-06-14 04:09:40
|
||||||
|
2023/09/26-11:55:44.081212 16 DB SUMMARY
|
||||||
|
2023/09/26-11:55:44.081214 16 DB Session ID: LDJPBRCKW95VBBDOA0BD
|
||||||
|
2023/09/26-11:55:44.081238 16 CURRENT file: CURRENT
|
||||||
|
2023/09/26-11:55:44.081240 16 IDENTITY file: IDENTITY
|
||||||
|
2023/09/26-11:55:44.081245 16 MANIFEST file: MANIFEST-000010 size: 199 Bytes
|
||||||
|
2023/09/26-11:55:44.081247 16 SST files in /var/lib/milvus/rdb_data dir, Total Num: 1, files: 000009.sst
|
||||||
|
2023/09/26-11:55:44.081248 16 Write Ahead Log file in /var/lib/milvus/rdb_data: 000011.log size: 41195590 ;
|
||||||
|
2023/09/26-11:55:44.081250 16 Options.error_if_exists: 0
|
||||||
|
2023/09/26-11:55:44.081252 16 Options.create_if_missing: 1
|
||||||
|
2023/09/26-11:55:44.081253 16 Options.paranoid_checks: 1
|
||||||
|
2023/09/26-11:55:44.081254 16 Options.flush_verify_memtable_count: 1
|
||||||
|
2023/09/26-11:55:44.081255 16 Options.track_and_verify_wals_in_manifest: 0
|
||||||
|
2023/09/26-11:55:44.081257 16 Options.env: 0x5e1d140
|
||||||
|
2023/09/26-11:55:44.081258 16 Options.fs: PosixFileSystem
|
||||||
|
2023/09/26-11:55:44.081259 16 Options.info_log: 0x7f9f31e4e370
|
||||||
|
2023/09/26-11:55:44.081261 16 Options.max_file_opening_threads: 16
|
||||||
|
2023/09/26-11:55:44.081262 16 Options.statistics: (nil)
|
||||||
|
2023/09/26-11:55:44.081264 16 Options.use_fsync: 0
|
||||||
|
2023/09/26-11:55:44.081265 16 Options.max_log_file_size: 0
|
||||||
|
2023/09/26-11:55:44.081266 16 Options.max_manifest_file_size: 1073741824
|
||||||
|
2023/09/26-11:55:44.081267 16 Options.log_file_time_to_roll: 0
|
||||||
|
2023/09/26-11:55:44.081269 16 Options.keep_log_file_num: 1000
|
||||||
|
2023/09/26-11:55:44.081270 16 Options.recycle_log_file_num: 0
|
||||||
|
2023/09/26-11:55:44.081271 16 Options.allow_fallocate: 1
|
||||||
|
2023/09/26-11:55:44.081272 16 Options.allow_mmap_reads: 0
|
||||||
|
2023/09/26-11:55:44.081273 16 Options.allow_mmap_writes: 0
|
||||||
|
2023/09/26-11:55:44.081274 16 Options.use_direct_reads: 0
|
||||||
|
2023/09/26-11:55:44.081276 16 Options.use_direct_io_for_flush_and_compaction: 0
|
||||||
|
2023/09/26-11:55:44.081277 16 Options.create_missing_column_families: 0
|
||||||
|
2023/09/26-11:55:44.081278 16 Options.db_log_dir:
|
||||||
|
2023/09/26-11:55:44.081279 16 Options.wal_dir:
|
||||||
|
2023/09/26-11:55:44.081281 16 Options.table_cache_numshardbits: 6
|
||||||
|
2023/09/26-11:55:44.081282 16 Options.WAL_ttl_seconds: 0
|
||||||
|
2023/09/26-11:55:44.081283 16 Options.WAL_size_limit_MB: 0
|
||||||
|
2023/09/26-11:55:44.081284 16 Options.max_write_batch_group_size_bytes: 1048576
|
||||||
|
2023/09/26-11:55:44.081285 16 Options.manifest_preallocation_size: 4194304
|
||||||
|
2023/09/26-11:55:44.081286 16 Options.is_fd_close_on_exec: 1
|
||||||
|
2023/09/26-11:55:44.081288 16 Options.advise_random_on_open: 1
|
||||||
|
2023/09/26-11:55:44.081289 16 Options.experimental_mempurge_threshold: 0.000000
|
||||||
|
2023/09/26-11:55:44.081291 16 Options.db_write_buffer_size: 0
|
||||||
|
2023/09/26-11:55:44.081293 16 Options.write_buffer_manager: 0x7f9f31e0a280
|
||||||
|
2023/09/26-11:55:44.081294 16 Options.access_hint_on_compaction_start: 1
|
||||||
|
2023/09/26-11:55:44.081295 16 Options.new_table_reader_for_compaction_inputs: 0
|
||||||
|
2023/09/26-11:55:44.081296 16 Options.random_access_max_buffer_size: 1048576
|
||||||
|
2023/09/26-11:55:44.081298 16 Options.use_adaptive_mutex: 0
|
||||||
|
2023/09/26-11:55:44.081299 16 Options.rate_limiter: (nil)
|
||||||
|
2023/09/26-11:55:44.081300 16 Options.sst_file_manager.rate_bytes_per_sec: 0
|
||||||
|
2023/09/26-11:55:44.081302 16 Options.wal_recovery_mode: 2
|
||||||
|
2023/09/26-11:55:44.081308 16 Options.enable_thread_tracking: 0
|
||||||
|
2023/09/26-11:55:44.081309 16 Options.enable_pipelined_write: 0
|
||||||
|
2023/09/26-11:55:44.081311 16 Options.unordered_write: 0
|
||||||
|
2023/09/26-11:55:44.081312 16 Options.allow_concurrent_memtable_write: 1
|
||||||
|
2023/09/26-11:55:44.081313 16 Options.enable_write_thread_adaptive_yield: 1
|
||||||
|
2023/09/26-11:55:44.081314 16 Options.write_thread_max_yield_usec: 100
|
||||||
|
2023/09/26-11:55:44.081316 16 Options.write_thread_slow_yield_usec: 3
|
||||||
|
2023/09/26-11:55:44.081317 16 Options.row_cache: None
|
||||||
|
2023/09/26-11:55:44.081318 16 Options.wal_filter: None
|
||||||
|
2023/09/26-11:55:44.081320 16 Options.avoid_flush_during_recovery: 0
|
||||||
|
2023/09/26-11:55:44.081321 16 Options.allow_ingest_behind: 0
|
||||||
|
2023/09/26-11:55:44.081322 16 Options.preserve_deletes: 0
|
||||||
|
2023/09/26-11:55:44.081323 16 Options.two_write_queues: 0
|
||||||
|
2023/09/26-11:55:44.081324 16 Options.manual_wal_flush: 0
|
||||||
|
2023/09/26-11:55:44.081326 16 Options.atomic_flush: 0
|
||||||
|
2023/09/26-11:55:44.081327 16 Options.avoid_unnecessary_blocking_io: 0
|
||||||
|
2023/09/26-11:55:44.081328 16 Options.persist_stats_to_disk: 0
|
||||||
|
2023/09/26-11:55:44.081329 16 Options.write_dbid_to_manifest: 0
|
||||||
|
2023/09/26-11:55:44.081330 16 Options.log_readahead_size: 0
|
||||||
|
2023/09/26-11:55:44.081332 16 Options.file_checksum_gen_factory: Unknown
|
||||||
|
2023/09/26-11:55:44.081333 16 Options.best_efforts_recovery: 0
|
||||||
|
2023/09/26-11:55:44.081334 16 Options.max_bgerror_resume_count: 2147483647
|
||||||
|
2023/09/26-11:55:44.081335 16 Options.bgerror_resume_retry_interval: 1000000
|
||||||
|
2023/09/26-11:55:44.081337 16 Options.allow_data_in_errors: 0
|
||||||
|
2023/09/26-11:55:44.081338 16 Options.db_host_id: __hostname__
|
||||||
|
2023/09/26-11:55:44.081340 16 Options.max_background_jobs: 1
|
||||||
|
2023/09/26-11:55:44.081341 16 Options.max_background_compactions: -1
|
||||||
|
2023/09/26-11:55:44.081342 16 Options.max_subcompactions: 1
|
||||||
|
2023/09/26-11:55:44.081344 16 Options.avoid_flush_during_shutdown: 0
|
||||||
|
2023/09/26-11:55:44.081345 16 Options.writable_file_max_buffer_size: 1048576
|
||||||
|
2023/09/26-11:55:44.081346 16 Options.delayed_write_rate : 16777216
|
||||||
|
2023/09/26-11:55:44.081348 16 Options.max_total_wal_size: 0
|
||||||
|
2023/09/26-11:55:44.081349 16 Options.delete_obsolete_files_period_micros: 21600000000
|
||||||
|
2023/09/26-11:55:44.081350 16 Options.stats_dump_period_sec: 600
|
||||||
|
2023/09/26-11:55:44.081352 16 Options.stats_persist_period_sec: 600
|
||||||
|
2023/09/26-11:55:44.081353 16 Options.stats_history_buffer_size: 1048576
|
||||||
|
2023/09/26-11:55:44.081354 16 Options.max_open_files: -1
|
||||||
|
2023/09/26-11:55:44.081356 16 Options.bytes_per_sync: 0
|
||||||
|
2023/09/26-11:55:44.081357 16 Options.wal_bytes_per_sync: 0
|
||||||
|
2023/09/26-11:55:44.081358 16 Options.strict_bytes_per_sync: 0
|
||||||
|
2023/09/26-11:55:44.081360 16 Options.compaction_readahead_size: 0
|
||||||
|
2023/09/26-11:55:44.081361 16 Options.max_background_flushes: 1
|
||||||
|
2023/09/26-11:55:44.081362 16 Compression algorithms supported:
|
||||||
|
2023/09/26-11:55:44.081364 16 kZSTDNotFinalCompression supported: 1
|
||||||
|
2023/09/26-11:55:44.081366 16 kZSTD supported: 1
|
||||||
|
2023/09/26-11:55:44.081367 16 kXpressCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.081369 16 kLZ4HCCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.081370 16 kLZ4Compression supported: 0
|
||||||
|
2023/09/26-11:55:44.081372 16 kBZip2Compression supported: 0
|
||||||
|
2023/09/26-11:55:44.081373 16 kZlibCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.081375 16 kSnappyCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.081377 16 Fast CRC32 supported: Supported on x86
|
||||||
|
2023/09/26-11:55:44.081417 16 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data/MANIFEST-000010
|
||||||
|
2023/09/26-11:55:44.081519 16 [db/column_family.cc:605] --------------- Options for column family [default]:
|
||||||
|
2023/09/26-11:55:44.081521 16 Options.comparator: leveldb.BytewiseComparator
|
||||||
|
2023/09/26-11:55:44.081522 16 Options.merge_operator: None
|
||||||
|
2023/09/26-11:55:44.081524 16 Options.compaction_filter: None
|
||||||
|
2023/09/26-11:55:44.081525 16 Options.compaction_filter_factory: None
|
||||||
|
2023/09/26-11:55:44.081526 16 Options.sst_partitioner_factory: None
|
||||||
|
2023/09/26-11:55:44.081528 16 Options.memtable_factory: SkipListFactory
|
||||||
|
2023/09/26-11:55:44.081529 16 Options.table_factory: BlockBasedTable
|
||||||
|
2023/09/26-11:55:44.081553 16 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9f31e00680)
|
||||||
|
cache_index_and_filter_blocks: 0
|
||||||
|
cache_index_and_filter_blocks_with_high_priority: 1
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache: 0
|
||||||
|
pin_top_level_index_and_filter: 1
|
||||||
|
index_type: 0
|
||||||
|
data_block_index_type: 0
|
||||||
|
index_shortening: 1
|
||||||
|
data_block_hash_table_util_ratio: 0.750000
|
||||||
|
hash_index_allow_collision: 1
|
||||||
|
checksum: 1
|
||||||
|
no_block_cache: 0
|
||||||
|
block_cache: 0x7f9f31e0a010
|
||||||
|
block_cache_name: LRUCache
|
||||||
|
block_cache_options:
|
||||||
|
capacity : 2502992855
|
||||||
|
num_shard_bits : 6
|
||||||
|
strict_capacity_limit : 0
|
||||||
|
memory_allocator : None
|
||||||
|
high_pri_pool_ratio: 0.500
|
||||||
|
block_cache_compressed: (nil)
|
||||||
|
persistent_cache: (nil)
|
||||||
|
block_size: 65536
|
||||||
|
block_size_deviation: 10
|
||||||
|
block_restart_interval: 16
|
||||||
|
index_block_restart_interval: 1
|
||||||
|
metadata_block_size: 4096
|
||||||
|
partition_filters: 0
|
||||||
|
use_delta_encoding: 1
|
||||||
|
filter_policy: nullptr
|
||||||
|
whole_key_filtering: 1
|
||||||
|
verify_compression: 0
|
||||||
|
read_amp_bytes_per_bit: 0
|
||||||
|
format_version: 5
|
||||||
|
enable_index_compression: 1
|
||||||
|
block_align: 0
|
||||||
|
max_auto_readahead_size: 262144
|
||||||
|
prepopulate_block_cache: 0
|
||||||
|
2023/09/26-11:55:44.081555 16 Options.write_buffer_size: 67108864
|
||||||
|
2023/09/26-11:55:44.081556 16 Options.max_write_buffer_number: 2
|
||||||
|
2023/09/26-11:55:44.081558 16 Options.compression[0]: NoCompression
|
||||||
|
2023/09/26-11:55:44.081559 16 Options.compression[1]: ZSTD
|
||||||
|
2023/09/26-11:55:44.081561 16 Options.compression[2]: ZSTD
|
||||||
|
2023/09/26-11:55:44.081562 16 Options.bottommost_compression: Disabled
|
||||||
|
2023/09/26-11:55:44.081563 16 Options.prefix_extractor: nullptr
|
||||||
|
2023/09/26-11:55:44.081565 16 Options.memtable_insert_with_hint_prefix_extractor: nullptr
|
||||||
|
2023/09/26-11:55:44.081566 16 Options.num_levels: 7
|
||||||
|
2023/09/26-11:55:44.081567 16 Options.min_write_buffer_number_to_merge: 1
|
||||||
|
2023/09/26-11:55:44.081569 16 Options.max_write_buffer_number_to_maintain: 0
|
||||||
|
2023/09/26-11:55:44.081570 16 Options.max_write_buffer_size_to_maintain: 0
|
||||||
|
2023/09/26-11:55:44.081571 16 Options.bottommost_compression_opts.window_bits: -14
|
||||||
|
2023/09/26-11:55:44.081573 16 Options.bottommost_compression_opts.level: 32767
|
||||||
|
2023/09/26-11:55:44.081574 16 Options.bottommost_compression_opts.strategy: 0
|
||||||
|
2023/09/26-11:55:44.081575 16 Options.bottommost_compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-11:55:44.081577 16 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-11:55:44.081578 16 Options.bottommost_compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-11:55:44.081579 16 Options.bottommost_compression_opts.enabled: false
|
||||||
|
2023/09/26-11:55:44.081581 16 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-11:55:44.081582 16 Options.compression_opts.window_bits: -14
|
||||||
|
2023/09/26-11:55:44.081583 16 Options.compression_opts.level: 32767
|
||||||
|
2023/09/26-11:55:44.081585 16 Options.compression_opts.strategy: 0
|
||||||
|
2023/09/26-11:55:44.081586 16 Options.compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-11:55:44.081587 16 Options.compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-11:55:44.081589 16 Options.compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-11:55:44.081590 16 Options.compression_opts.enabled: false
|
||||||
|
2023/09/26-11:55:44.081591 16 Options.compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-11:55:44.081597 16 Options.level0_file_num_compaction_trigger: 4
|
||||||
|
2023/09/26-11:55:44.081598 16 Options.level0_slowdown_writes_trigger: 20
|
||||||
|
2023/09/26-11:55:44.081600 16 Options.level0_stop_writes_trigger: 36
|
||||||
|
2023/09/26-11:55:44.081601 16 Options.target_file_size_base: 67108864
|
||||||
|
2023/09/26-11:55:44.081602 16 Options.target_file_size_multiplier: 2
|
||||||
|
2023/09/26-11:55:44.081604 16 Options.max_bytes_for_level_base: 268435456
|
||||||
|
2023/09/26-11:55:44.081605 16 Options.level_compaction_dynamic_level_bytes: 0
|
||||||
|
2023/09/26-11:55:44.081606 16 Options.max_bytes_for_level_multiplier: 10.000000
|
||||||
|
2023/09/26-11:55:44.081608 16 Options.max_bytes_for_level_multiplier_addtl[0]: 1
|
||||||
|
2023/09/26-11:55:44.081610 16 Options.max_bytes_for_level_multiplier_addtl[1]: 1
|
||||||
|
2023/09/26-11:55:44.081611 16 Options.max_bytes_for_level_multiplier_addtl[2]: 1
|
||||||
|
2023/09/26-11:55:44.081613 16 Options.max_bytes_for_level_multiplier_addtl[3]: 1
|
||||||
|
2023/09/26-11:55:44.081614 16 Options.max_bytes_for_level_multiplier_addtl[4]: 1
|
||||||
|
2023/09/26-11:55:44.081615 16 Options.max_bytes_for_level_multiplier_addtl[5]: 1
|
||||||
|
2023/09/26-11:55:44.081617 16 Options.max_bytes_for_level_multiplier_addtl[6]: 1
|
||||||
|
2023/09/26-11:55:44.081618 16 Options.max_sequential_skip_in_iterations: 8
|
||||||
|
2023/09/26-11:55:44.081619 16 Options.max_compaction_bytes: 1677721600
|
||||||
|
2023/09/26-11:55:44.081621 16 Options.arena_block_size: 1048576
|
||||||
|
2023/09/26-11:55:44.081622 16 Options.soft_pending_compaction_bytes_limit: 68719476736
|
||||||
|
2023/09/26-11:55:44.081623 16 Options.hard_pending_compaction_bytes_limit: 274877906944
|
||||||
|
2023/09/26-11:55:44.081625 16 Options.rate_limit_delay_max_milliseconds: 100
|
||||||
|
2023/09/26-11:55:44.081626 16 Options.disable_auto_compactions: 0
|
||||||
|
2023/09/26-11:55:44.081628 16 Options.compaction_style: kCompactionStyleLevel
|
||||||
|
2023/09/26-11:55:44.081629 16 Options.compaction_pri: kMinOverlappingRatio
|
||||||
|
2023/09/26-11:55:44.081631 16 Options.compaction_options_universal.size_ratio: 1
|
||||||
|
2023/09/26-11:55:44.081632 16 Options.compaction_options_universal.min_merge_width: 2
|
||||||
|
2023/09/26-11:55:44.081633 16 Options.compaction_options_universal.max_merge_width: 4294967295
|
||||||
|
2023/09/26-11:55:44.081634 16 Options.compaction_options_universal.max_size_amplification_percent: 200
|
||||||
|
2023/09/26-11:55:44.081636 16 Options.compaction_options_universal.compression_size_percent: -1
|
||||||
|
2023/09/26-11:55:44.081637 16 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
|
||||||
|
2023/09/26-11:55:44.081639 16 Options.compaction_options_fifo.max_table_files_size: 1073741824
|
||||||
|
2023/09/26-11:55:44.081640 16 Options.compaction_options_fifo.allow_compaction: 0
|
||||||
|
2023/09/26-11:55:44.081643 16 Options.table_properties_collectors:
|
||||||
|
2023/09/26-11:55:44.081644 16 Options.inplace_update_support: 0
|
||||||
|
2023/09/26-11:55:44.081646 16 Options.inplace_update_num_locks: 10000
|
||||||
|
2023/09/26-11:55:44.081647 16 Options.memtable_prefix_bloom_size_ratio: 0.000000
|
||||||
|
2023/09/26-11:55:44.081649 16 Options.memtable_whole_key_filtering: 0
|
||||||
|
2023/09/26-11:55:44.081650 16 Options.memtable_huge_page_size: 0
|
||||||
|
2023/09/26-11:55:44.081651 16 Options.bloom_locality: 0
|
||||||
|
2023/09/26-11:55:44.081653 16 Options.max_successive_merges: 0
|
||||||
|
2023/09/26-11:55:44.081654 16 Options.optimize_filters_for_hits: 0
|
||||||
|
2023/09/26-11:55:44.081655 16 Options.paranoid_file_checks: 0
|
||||||
|
2023/09/26-11:55:44.081657 16 Options.force_consistency_checks: 1
|
||||||
|
2023/09/26-11:55:44.081658 16 Options.report_bg_io_stats: 0
|
||||||
|
2023/09/26-11:55:44.081659 16 Options.ttl: 2592000
|
||||||
|
2023/09/26-11:55:44.081661 16 Options.periodic_compaction_seconds: 0
|
||||||
|
2023/09/26-11:55:44.081662 16 Options.enable_blob_files: false
|
||||||
|
2023/09/26-11:55:44.081664 16 Options.min_blob_size: 0
|
||||||
|
2023/09/26-11:55:44.081668 16 Options.blob_file_size: 268435456
|
||||||
|
2023/09/26-11:55:44.081670 16 Options.blob_compression_type: NoCompression
|
||||||
|
2023/09/26-11:55:44.081671 16 Options.enable_blob_garbage_collection: false
|
||||||
|
2023/09/26-11:55:44.081673 16 Options.blob_garbage_collection_age_cutoff: 0.250000
|
||||||
|
2023/09/26-11:55:44.081674 16 Options.blob_garbage_collection_force_threshold: 1.000000
|
||||||
|
2023/09/26-11:55:44.081676 16 Options.blob_compaction_readahead_size: 0
|
||||||
|
2023/09/26-11:55:44.082640 16 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 124, log_number is 6,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
|
||||||
|
2023/09/26-11:55:44.082644 16 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 6
|
||||||
|
2023/09/26-11:55:44.082692 16 [db/version_set.cc:4384] Creating manifest 14
|
||||||
|
2023/09/26-11:55:44.086428 16 EVENT_LOG_v1 {"time_micros": 1695729344086425, "job": 1, "event": "recovery_started", "wal_files": [11]}
|
||||||
|
2023/09/26-11:55:44.086432 16 [db/db_impl/db_impl_open.cc:883] Recovering log #11 mode 2
|
||||||
|
2023/09/26-11:55:44.256400 16 EVENT_LOG_v1 {"time_micros": 1695729344256373, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 15, "file_size": 37541350, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 37537394, "index_size": 3027, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 3740797, "raw_average_key_size": 51, "raw_value_size": 36432821, "raw_average_value_size": 503, "num_data_blocks": 53, "num_entries": 72403, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695729344, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d", "db_session_id": "LDJPBRCKW95VBBDOA0BD", "orig_file_number": 15}}
|
||||||
|
2023/09/26-11:55:44.258050 16 [db/version_set.cc:4384] Creating manifest 16
|
||||||
|
2023/09/26-11:55:44.262135 16 EVENT_LOG_v1 {"time_micros": 1695729344262131, "job": 1, "event": "recovery_finished"}
|
||||||
|
2023/09/26-11:55:44.270917 16 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data/000011.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
|
||||||
|
2023/09/26-11:55:44.270940 16 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9f31e55380
|
||||||
|
2023/09/26-11:55:44.270978 16 DB pointer 0x7f9f31e3ac00
|
||||||
|
2023/09/26-11:55:47.271169 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:55:47.271190 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3.2 total, 3.2 interval
|
||||||
|
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3.2 total, 3.2 interval
|
||||||
|
Flush(GB): cumulative 0.035, interval 0.035
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.03 GB write, 11.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Interval compaction: 0.03 GB write, 11.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 1 last_copies: 1 last_secs: 3.6e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:05:47.271343 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:05:47.271375 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 603.2 total, 600.0 interval
|
||||||
|
Cumulative writes: 6989 writes, 6989 keys, 6989 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.03 MB/s
|
||||||
|
Cumulative WAL: 6989 writes, 0 syncs, 6989.00 writes per sync, written: 0.02 GB, 0.03 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 6989 writes, 6989 keys, 6989 commit groups, 1.0 writes per commit group, ingest: 17.04 MB, 0.03 MB/s
|
||||||
|
Interval WAL: 6989 writes, 0 syncs, 6989.00 writes per sync, written: 0.02 GB, 0.03 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 603.2 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.035, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.03 GB write, 0.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 2 last_copies: 1 last_secs: 4.8e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:15:47.271551 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:15:47.271585 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1203.2 total, 600.0 interval
|
||||||
|
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 14K writes, 0 syncs, 14113.00 writes per sync, written: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7124 writes, 7124 keys, 7124 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1203.2 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.035, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.03 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 3 last_copies: 1 last_secs: 5.7e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:25:47.271764 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:25:47.271807 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1803.2 total, 600.0 interval
|
||||||
|
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 21K writes, 0 syncs, 21224.00 writes per sync, written: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7111 writes, 7111 keys, 7111 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7111 writes, 0 syncs, 7111.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1803.2 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.035, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.03 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 4 last_copies: 1 last_secs: 4e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:35:47.271962 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:35:47.271993 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 2403.2 total, 600.0 interval
|
||||||
|
Cumulative writes: 28K writes, 28K keys, 28K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 28K writes, 0 syncs, 28348.00 writes per sync, written: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7124 writes, 7124 keys, 7123 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 2403.2 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.035, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.03 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 5 last_copies: 1 last_secs: 4.2e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:45:47.272184 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:45:47.272226 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3003.2 total, 600.0 interval
|
||||||
|
Cumulative writes: 35K writes, 35K keys, 35K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 35K writes, 0 syncs, 35461.00 writes per sync, written: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7113 writes, 7113 keys, 7112 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7113 writes, 0 syncs, 7113.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3003.2 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.035, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.03 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 6 last_copies: 1 last_secs: 9.4e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:55:47.272540 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:55:47.272617 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3603.2 total, 600.0 interval
|
||||||
|
Cumulative writes: 42K writes, 42K keys, 42K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative WAL: 42K writes, 0 syncs, 42550.00 writes per sync, written: 0.02 GB, 0.01 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7089 writes, 7089 keys, 7083 commit groups, 1.0 writes per commit group, ingest: 0.57 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7089 writes, 0 syncs, 7089.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3603.2 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.035, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.03 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 7 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
|
@ -0,0 +1,190 @@
|
||||||
|
# This is a RocksDB option file.
|
||||||
|
#
|
||||||
|
# For detailed file format spec, please refer to the example file
|
||||||
|
# in examples/rocksdb_option_file_example.ini
|
||||||
|
#
|
||||||
|
|
||||||
|
[Version]
|
||||||
|
rocksdb_version=6.27.3
|
||||||
|
options_file_version=1.1
|
||||||
|
|
||||||
|
[DBOptions]
|
||||||
|
max_open_files=-1
|
||||||
|
stats_history_buffer_size=1048576
|
||||||
|
stats_persist_period_sec=600
|
||||||
|
max_background_flushes=1
|
||||||
|
stats_dump_period_sec=600
|
||||||
|
compaction_readahead_size=0
|
||||||
|
bytes_per_sync=0
|
||||||
|
delete_obsolete_files_period_micros=21600000000
|
||||||
|
max_total_wal_size=0
|
||||||
|
delayed_write_rate=16777216
|
||||||
|
wal_bytes_per_sync=0
|
||||||
|
writable_file_max_buffer_size=1048576
|
||||||
|
avoid_flush_during_shutdown=false
|
||||||
|
max_subcompactions=1
|
||||||
|
strict_bytes_per_sync=false
|
||||||
|
max_background_compactions=-1
|
||||||
|
base_background_compactions=-1
|
||||||
|
max_background_jobs=1
|
||||||
|
file_checksum_gen_factory=nullptr
|
||||||
|
db_host_id=__hostname__
|
||||||
|
bgerror_resume_retry_interval=1000000
|
||||||
|
best_efforts_recovery=false
|
||||||
|
avoid_unnecessary_blocking_io=false
|
||||||
|
two_write_queues=false
|
||||||
|
atomic_flush=false
|
||||||
|
preserve_deletes=false
|
||||||
|
allow_ingest_behind=false
|
||||||
|
lowest_used_cache_tier=kNonVolatileBlockTier
|
||||||
|
avoid_flush_during_recovery=false
|
||||||
|
info_log_level=INFO_LEVEL
|
||||||
|
access_hint_on_compaction_start=NORMAL
|
||||||
|
max_bgerror_resume_count=2147483647
|
||||||
|
write_thread_slow_yield_usec=3
|
||||||
|
allow_concurrent_memtable_write=true
|
||||||
|
WAL_ttl_seconds=0
|
||||||
|
manual_wal_flush=false
|
||||||
|
dump_malloc_stats=false
|
||||||
|
wal_recovery_mode=kPointInTimeRecovery
|
||||||
|
log_file_time_to_roll=0
|
||||||
|
enable_write_thread_adaptive_yield=true
|
||||||
|
recycle_log_file_num=0
|
||||||
|
table_cache_numshardbits=6
|
||||||
|
max_file_opening_threads=16
|
||||||
|
allow_data_in_errors=false
|
||||||
|
use_fsync=false
|
||||||
|
unordered_write=false
|
||||||
|
fail_if_options_file_error=false
|
||||||
|
random_access_max_buffer_size=1048576
|
||||||
|
new_table_reader_for_compaction_inputs=false
|
||||||
|
skip_checking_sst_file_sizes_on_db_open=false
|
||||||
|
skip_stats_update_on_db_open=false
|
||||||
|
persist_stats_to_disk=false
|
||||||
|
track_and_verify_wals_in_manifest=false
|
||||||
|
enable_pipelined_write=false
|
||||||
|
flush_verify_memtable_count=true
|
||||||
|
log_readahead_size=0
|
||||||
|
is_fd_close_on_exec=true
|
||||||
|
WAL_size_limit_MB=0
|
||||||
|
experimental_mempurge_threshold=0.000000
|
||||||
|
write_dbid_to_manifest=false
|
||||||
|
use_adaptive_mutex=false
|
||||||
|
error_if_exists=false
|
||||||
|
write_thread_max_yield_usec=100
|
||||||
|
enable_thread_tracking=false
|
||||||
|
db_write_buffer_size=0
|
||||||
|
create_missing_column_families=false
|
||||||
|
paranoid_checks=true
|
||||||
|
create_if_missing=true
|
||||||
|
wal_filter=nullptr
|
||||||
|
max_manifest_file_size=1073741824
|
||||||
|
allow_2pc=false
|
||||||
|
use_direct_io_for_flush_and_compaction=false
|
||||||
|
manifest_preallocation_size=4194304
|
||||||
|
use_direct_reads=false
|
||||||
|
allow_fallocate=true
|
||||||
|
max_write_batch_group_size_bytes=1048576
|
||||||
|
keep_log_file_num=1000
|
||||||
|
allow_mmap_reads=false
|
||||||
|
max_log_file_size=0
|
||||||
|
allow_mmap_writes=false
|
||||||
|
advise_random_on_open=true
|
||||||
|
|
||||||
|
|
||||||
|
[CFOptions "default"]
|
||||||
|
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
bottommost_compression=kDisableCompressionOption
|
||||||
|
enable_blob_garbage_collection=false
|
||||||
|
blob_file_size=268435456
|
||||||
|
sample_for_compression=0
|
||||||
|
periodic_compaction_seconds=0
|
||||||
|
ttl=2592000
|
||||||
|
blob_garbage_collection_age_cutoff=0.250000
|
||||||
|
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
|
||||||
|
compression=kNoCompression
|
||||||
|
max_sequential_skip_in_iterations=8
|
||||||
|
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
|
||||||
|
max_bytes_for_level_multiplier=10.000000
|
||||||
|
max_bytes_for_level_base=268435456
|
||||||
|
memtable_whole_key_filtering=false
|
||||||
|
max_successive_merges=0
|
||||||
|
blob_compaction_readahead_size=0
|
||||||
|
inplace_update_num_locks=10000
|
||||||
|
arena_block_size=1048576
|
||||||
|
target_file_size_multiplier=2
|
||||||
|
prefix_extractor=nullptr
|
||||||
|
max_write_buffer_number=2
|
||||||
|
blob_compression_type=kNoCompression
|
||||||
|
level0_stop_writes_trigger=36
|
||||||
|
level0_slowdown_writes_trigger=20
|
||||||
|
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
|
||||||
|
level0_file_num_compaction_trigger=4
|
||||||
|
write_buffer_size=67108864
|
||||||
|
memtable_huge_page_size=0
|
||||||
|
max_compaction_bytes=1677721600
|
||||||
|
min_blob_size=0
|
||||||
|
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
hard_pending_compaction_bytes_limit=274877906944
|
||||||
|
target_file_size_base=67108864
|
||||||
|
soft_pending_compaction_bytes_limit=68719476736
|
||||||
|
enable_blob_files=false
|
||||||
|
paranoid_file_checks=false
|
||||||
|
check_flush_compaction_key_order=true
|
||||||
|
blob_garbage_collection_force_threshold=1.000000
|
||||||
|
disable_auto_compactions=false
|
||||||
|
memtable_prefix_bloom_size_ratio=0.000000
|
||||||
|
report_bg_io_stats=false
|
||||||
|
compaction_pri=kMinOverlappingRatio
|
||||||
|
compaction_filter_factory=nullptr
|
||||||
|
comparator=leveldb.BytewiseComparator
|
||||||
|
sst_partitioner_factory=nullptr
|
||||||
|
bloom_locality=0
|
||||||
|
compaction_style=kCompactionStyleLevel
|
||||||
|
min_write_buffer_number_to_merge=1
|
||||||
|
max_write_buffer_size_to_maintain=0
|
||||||
|
max_write_buffer_number_to_maintain=0
|
||||||
|
merge_operator=nullptr
|
||||||
|
memtable_factory=SkipListFactory
|
||||||
|
memtable_insert_with_hint_prefix_extractor=nullptr
|
||||||
|
compression_per_level=kNoCompression:kZSTD:kZSTD
|
||||||
|
num_levels=7
|
||||||
|
force_consistency_checks=true
|
||||||
|
optimize_filters_for_hits=false
|
||||||
|
compaction_filter=nullptr
|
||||||
|
level_compaction_dynamic_level_bytes=false
|
||||||
|
inplace_update_support=false
|
||||||
|
table_factory=BlockBasedTable
|
||||||
|
|
||||||
|
[TableOptions/BlockBasedTable "default"]
|
||||||
|
pin_top_level_index_and_filter=true
|
||||||
|
block_align=false
|
||||||
|
read_amp_bytes_per_bit=0
|
||||||
|
verify_compression=false
|
||||||
|
enable_index_compression=true
|
||||||
|
reserve_table_builder_memory=false
|
||||||
|
whole_key_filtering=true
|
||||||
|
max_auto_readahead_size=262144
|
||||||
|
optimize_filters_for_memory=false
|
||||||
|
index_block_restart_interval=1
|
||||||
|
prepopulate_block_cache=kDisable
|
||||||
|
block_restart_interval=16
|
||||||
|
block_size=65536
|
||||||
|
format_version=5
|
||||||
|
partition_filters=false
|
||||||
|
block_size_deviation=10
|
||||||
|
no_block_cache=false
|
||||||
|
checksum=kCRC32c
|
||||||
|
data_block_hash_table_util_ratio=0.750000
|
||||||
|
index_shortening=kShortenSeparators
|
||||||
|
data_block_index_type=kDataBlockBinarySearch
|
||||||
|
hash_index_allow_collision=true
|
||||||
|
filter_policy=nullptr
|
||||||
|
metadata_block_size=4096
|
||||||
|
index_type=kBinarySearch
|
||||||
|
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache=false
|
||||||
|
cache_index_and_filter_blocks_with_high_priority=true
|
||||||
|
cache_index_and_filter_blocks=false
|
||||||
|
flush_block_policy_factory=FlushBlockBySizePolicyFactory
|
||||||
|
|
|
@ -0,0 +1,190 @@
|
||||||
|
# This is a RocksDB option file.
|
||||||
|
#
|
||||||
|
# For detailed file format spec, please refer to the example file
|
||||||
|
# in examples/rocksdb_option_file_example.ini
|
||||||
|
#
|
||||||
|
|
||||||
|
[Version]
|
||||||
|
rocksdb_version=6.27.3
|
||||||
|
options_file_version=1.1
|
||||||
|
|
||||||
|
[DBOptions]
|
||||||
|
max_open_files=-1
|
||||||
|
stats_history_buffer_size=1048576
|
||||||
|
stats_persist_period_sec=600
|
||||||
|
max_background_flushes=1
|
||||||
|
stats_dump_period_sec=600
|
||||||
|
compaction_readahead_size=0
|
||||||
|
bytes_per_sync=0
|
||||||
|
delete_obsolete_files_period_micros=21600000000
|
||||||
|
max_total_wal_size=0
|
||||||
|
delayed_write_rate=16777216
|
||||||
|
wal_bytes_per_sync=0
|
||||||
|
writable_file_max_buffer_size=1048576
|
||||||
|
avoid_flush_during_shutdown=false
|
||||||
|
max_subcompactions=1
|
||||||
|
strict_bytes_per_sync=false
|
||||||
|
max_background_compactions=-1
|
||||||
|
base_background_compactions=-1
|
||||||
|
max_background_jobs=1
|
||||||
|
file_checksum_gen_factory=nullptr
|
||||||
|
db_host_id=__hostname__
|
||||||
|
bgerror_resume_retry_interval=1000000
|
||||||
|
best_efforts_recovery=false
|
||||||
|
avoid_unnecessary_blocking_io=false
|
||||||
|
two_write_queues=false
|
||||||
|
atomic_flush=false
|
||||||
|
preserve_deletes=false
|
||||||
|
allow_ingest_behind=false
|
||||||
|
lowest_used_cache_tier=kNonVolatileBlockTier
|
||||||
|
avoid_flush_during_recovery=false
|
||||||
|
info_log_level=INFO_LEVEL
|
||||||
|
access_hint_on_compaction_start=NORMAL
|
||||||
|
max_bgerror_resume_count=2147483647
|
||||||
|
write_thread_slow_yield_usec=3
|
||||||
|
allow_concurrent_memtable_write=true
|
||||||
|
WAL_ttl_seconds=0
|
||||||
|
manual_wal_flush=false
|
||||||
|
dump_malloc_stats=false
|
||||||
|
wal_recovery_mode=kPointInTimeRecovery
|
||||||
|
log_file_time_to_roll=0
|
||||||
|
enable_write_thread_adaptive_yield=true
|
||||||
|
recycle_log_file_num=0
|
||||||
|
table_cache_numshardbits=6
|
||||||
|
max_file_opening_threads=16
|
||||||
|
allow_data_in_errors=false
|
||||||
|
use_fsync=false
|
||||||
|
unordered_write=false
|
||||||
|
fail_if_options_file_error=false
|
||||||
|
random_access_max_buffer_size=1048576
|
||||||
|
new_table_reader_for_compaction_inputs=false
|
||||||
|
skip_checking_sst_file_sizes_on_db_open=false
|
||||||
|
skip_stats_update_on_db_open=false
|
||||||
|
persist_stats_to_disk=false
|
||||||
|
track_and_verify_wals_in_manifest=false
|
||||||
|
enable_pipelined_write=false
|
||||||
|
flush_verify_memtable_count=true
|
||||||
|
log_readahead_size=0
|
||||||
|
is_fd_close_on_exec=true
|
||||||
|
WAL_size_limit_MB=0
|
||||||
|
experimental_mempurge_threshold=0.000000
|
||||||
|
write_dbid_to_manifest=false
|
||||||
|
use_adaptive_mutex=false
|
||||||
|
error_if_exists=false
|
||||||
|
write_thread_max_yield_usec=100
|
||||||
|
enable_thread_tracking=false
|
||||||
|
db_write_buffer_size=0
|
||||||
|
create_missing_column_families=false
|
||||||
|
paranoid_checks=true
|
||||||
|
create_if_missing=true
|
||||||
|
wal_filter=nullptr
|
||||||
|
max_manifest_file_size=1073741824
|
||||||
|
allow_2pc=false
|
||||||
|
use_direct_io_for_flush_and_compaction=false
|
||||||
|
manifest_preallocation_size=4194304
|
||||||
|
use_direct_reads=false
|
||||||
|
allow_fallocate=true
|
||||||
|
max_write_batch_group_size_bytes=1048576
|
||||||
|
keep_log_file_num=1000
|
||||||
|
allow_mmap_reads=false
|
||||||
|
max_log_file_size=0
|
||||||
|
allow_mmap_writes=false
|
||||||
|
advise_random_on_open=true
|
||||||
|
|
||||||
|
|
||||||
|
[CFOptions "default"]
|
||||||
|
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
bottommost_compression=kDisableCompressionOption
|
||||||
|
enable_blob_garbage_collection=false
|
||||||
|
blob_file_size=268435456
|
||||||
|
sample_for_compression=0
|
||||||
|
periodic_compaction_seconds=0
|
||||||
|
ttl=2592000
|
||||||
|
blob_garbage_collection_age_cutoff=0.250000
|
||||||
|
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
|
||||||
|
compression=kNoCompression
|
||||||
|
max_sequential_skip_in_iterations=8
|
||||||
|
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
|
||||||
|
max_bytes_for_level_multiplier=10.000000
|
||||||
|
max_bytes_for_level_base=268435456
|
||||||
|
memtable_whole_key_filtering=false
|
||||||
|
max_successive_merges=0
|
||||||
|
blob_compaction_readahead_size=0
|
||||||
|
inplace_update_num_locks=10000
|
||||||
|
arena_block_size=1048576
|
||||||
|
target_file_size_multiplier=2
|
||||||
|
prefix_extractor=nullptr
|
||||||
|
max_write_buffer_number=2
|
||||||
|
blob_compression_type=kNoCompression
|
||||||
|
level0_stop_writes_trigger=36
|
||||||
|
level0_slowdown_writes_trigger=20
|
||||||
|
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
|
||||||
|
level0_file_num_compaction_trigger=4
|
||||||
|
write_buffer_size=67108864
|
||||||
|
memtable_huge_page_size=0
|
||||||
|
max_compaction_bytes=1677721600
|
||||||
|
min_blob_size=0
|
||||||
|
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
hard_pending_compaction_bytes_limit=274877906944
|
||||||
|
target_file_size_base=67108864
|
||||||
|
soft_pending_compaction_bytes_limit=68719476736
|
||||||
|
enable_blob_files=false
|
||||||
|
paranoid_file_checks=false
|
||||||
|
check_flush_compaction_key_order=true
|
||||||
|
blob_garbage_collection_force_threshold=1.000000
|
||||||
|
disable_auto_compactions=false
|
||||||
|
memtable_prefix_bloom_size_ratio=0.000000
|
||||||
|
report_bg_io_stats=false
|
||||||
|
compaction_pri=kMinOverlappingRatio
|
||||||
|
compaction_filter_factory=nullptr
|
||||||
|
comparator=leveldb.BytewiseComparator
|
||||||
|
sst_partitioner_factory=nullptr
|
||||||
|
bloom_locality=0
|
||||||
|
compaction_style=kCompactionStyleLevel
|
||||||
|
min_write_buffer_number_to_merge=1
|
||||||
|
max_write_buffer_size_to_maintain=0
|
||||||
|
max_write_buffer_number_to_maintain=0
|
||||||
|
merge_operator=nullptr
|
||||||
|
memtable_factory=SkipListFactory
|
||||||
|
memtable_insert_with_hint_prefix_extractor=nullptr
|
||||||
|
compression_per_level=kNoCompression:kZSTD:kZSTD
|
||||||
|
num_levels=7
|
||||||
|
force_consistency_checks=true
|
||||||
|
optimize_filters_for_hits=false
|
||||||
|
compaction_filter=nullptr
|
||||||
|
level_compaction_dynamic_level_bytes=false
|
||||||
|
inplace_update_support=false
|
||||||
|
table_factory=BlockBasedTable
|
||||||
|
|
||||||
|
[TableOptions/BlockBasedTable "default"]
|
||||||
|
pin_top_level_index_and_filter=true
|
||||||
|
block_align=false
|
||||||
|
read_amp_bytes_per_bit=0
|
||||||
|
verify_compression=false
|
||||||
|
enable_index_compression=true
|
||||||
|
reserve_table_builder_memory=false
|
||||||
|
whole_key_filtering=true
|
||||||
|
max_auto_readahead_size=262144
|
||||||
|
optimize_filters_for_memory=false
|
||||||
|
index_block_restart_interval=1
|
||||||
|
prepopulate_block_cache=kDisable
|
||||||
|
block_restart_interval=16
|
||||||
|
block_size=65536
|
||||||
|
format_version=5
|
||||||
|
partition_filters=false
|
||||||
|
block_size_deviation=10
|
||||||
|
no_block_cache=false
|
||||||
|
checksum=kCRC32c
|
||||||
|
data_block_hash_table_util_ratio=0.750000
|
||||||
|
index_shortening=kShortenSeparators
|
||||||
|
data_block_index_type=kDataBlockBinarySearch
|
||||||
|
hash_index_allow_collision=true
|
||||||
|
filter_policy=nullptr
|
||||||
|
metadata_block_size=4096
|
||||||
|
index_type=kBinarySearch
|
||||||
|
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache=false
|
||||||
|
cache_index_and_filter_blocks_with_high_priority=true
|
||||||
|
cache_index_and_filter_blocks=false
|
||||||
|
flush_block_policy_factory=FlushBlockBySizePolicyFactory
|
||||||
|
|
|
@ -0,0 +1 @@
|
||||||
|
MANIFEST-000022
|
|
@ -0,0 +1 @@
|
||||||
|
cf0fe53a-7182-458f-baa9-e07d3ffe5860
|
|
@ -0,0 +1,395 @@
|
||||||
|
2023/09/26-17:03:48.661505 14 RocksDB version: 6.27.3
|
||||||
|
2023/09/26-17:03:48.661926 14 Git sha 0
|
||||||
|
2023/09/26-17:03:48.661928 14 Compile date 2023-06-14 04:09:40
|
||||||
|
2023/09/26-17:03:48.662068 14 DB SUMMARY
|
||||||
|
2023/09/26-17:03:48.662069 14 DB Session ID: 345C9WGIGWXHNGD85BUM
|
||||||
|
2023/09/26-17:03:48.662351 14 CURRENT file: CURRENT
|
||||||
|
2023/09/26-17:03:48.662352 14 IDENTITY file: IDENTITY
|
||||||
|
2023/09/26-17:03:48.662357 14 MANIFEST file: MANIFEST-000016 size: 315 Bytes
|
||||||
|
2023/09/26-17:03:48.662358 14 SST files in /var/lib/milvus/rdb_data_meta_kv dir, Total Num: 2, files: 000009.sst 000015.sst
|
||||||
|
2023/09/26-17:03:48.662359 14 Write Ahead Log file in /var/lib/milvus/rdb_data_meta_kv: 000017.log size: 3209895 ;
|
||||||
|
2023/09/26-17:03:48.662360 14 Options.error_if_exists: 0
|
||||||
|
2023/09/26-17:03:48.662361 14 Options.create_if_missing: 1
|
||||||
|
2023/09/26-17:03:48.662362 14 Options.paranoid_checks: 1
|
||||||
|
2023/09/26-17:03:48.662363 14 Options.flush_verify_memtable_count: 1
|
||||||
|
2023/09/26-17:03:48.662364 14 Options.track_and_verify_wals_in_manifest: 0
|
||||||
|
2023/09/26-17:03:48.662364 14 Options.env: 0x5e1d140
|
||||||
|
2023/09/26-17:03:48.662366 14 Options.fs: PosixFileSystem
|
||||||
|
2023/09/26-17:03:48.662367 14 Options.info_log: 0x7f9d2084e050
|
||||||
|
2023/09/26-17:03:48.662367 14 Options.max_file_opening_threads: 16
|
||||||
|
2023/09/26-17:03:48.662368 14 Options.statistics: (nil)
|
||||||
|
2023/09/26-17:03:48.662369 14 Options.use_fsync: 0
|
||||||
|
2023/09/26-17:03:48.662370 14 Options.max_log_file_size: 0
|
||||||
|
2023/09/26-17:03:48.662370 14 Options.max_manifest_file_size: 1073741824
|
||||||
|
2023/09/26-17:03:48.662371 14 Options.log_file_time_to_roll: 0
|
||||||
|
2023/09/26-17:03:48.662372 14 Options.keep_log_file_num: 1000
|
||||||
|
2023/09/26-17:03:48.662373 14 Options.recycle_log_file_num: 0
|
||||||
|
2023/09/26-17:03:48.662374 14 Options.allow_fallocate: 1
|
||||||
|
2023/09/26-17:03:48.662375 14 Options.allow_mmap_reads: 0
|
||||||
|
2023/09/26-17:03:48.662375 14 Options.allow_mmap_writes: 0
|
||||||
|
2023/09/26-17:03:48.662376 14 Options.use_direct_reads: 0
|
||||||
|
2023/09/26-17:03:48.662377 14 Options.use_direct_io_for_flush_and_compaction: 0
|
||||||
|
2023/09/26-17:03:48.662377 14 Options.create_missing_column_families: 0
|
||||||
|
2023/09/26-17:03:48.662378 14 Options.db_log_dir:
|
||||||
|
2023/09/26-17:03:48.662379 14 Options.wal_dir:
|
||||||
|
2023/09/26-17:03:48.662380 14 Options.table_cache_numshardbits: 6
|
||||||
|
2023/09/26-17:03:48.662380 14 Options.WAL_ttl_seconds: 0
|
||||||
|
2023/09/26-17:03:48.662381 14 Options.WAL_size_limit_MB: 0
|
||||||
|
2023/09/26-17:03:48.662382 14 Options.max_write_batch_group_size_bytes: 1048576
|
||||||
|
2023/09/26-17:03:48.662383 14 Options.manifest_preallocation_size: 4194304
|
||||||
|
2023/09/26-17:03:48.662384 14 Options.is_fd_close_on_exec: 1
|
||||||
|
2023/09/26-17:03:48.662385 14 Options.advise_random_on_open: 1
|
||||||
|
2023/09/26-17:03:48.662385 14 Options.experimental_mempurge_threshold: 0.000000
|
||||||
|
2023/09/26-17:03:48.662545 14 Options.db_write_buffer_size: 0
|
||||||
|
2023/09/26-17:03:48.662546 14 Options.write_buffer_manager: 0x7f9d2080a0a0
|
||||||
|
2023/09/26-17:03:48.662547 14 Options.access_hint_on_compaction_start: 1
|
||||||
|
2023/09/26-17:03:48.662548 14 Options.new_table_reader_for_compaction_inputs: 0
|
||||||
|
2023/09/26-17:03:48.662548 14 Options.random_access_max_buffer_size: 1048576
|
||||||
|
2023/09/26-17:03:48.662549 14 Options.use_adaptive_mutex: 0
|
||||||
|
2023/09/26-17:03:48.662550 14 Options.rate_limiter: (nil)
|
||||||
|
2023/09/26-17:03:48.662551 14 Options.sst_file_manager.rate_bytes_per_sec: 0
|
||||||
|
2023/09/26-17:03:48.662552 14 Options.wal_recovery_mode: 2
|
||||||
|
2023/09/26-17:03:48.662559 14 Options.enable_thread_tracking: 0
|
||||||
|
2023/09/26-17:03:48.662560 14 Options.enable_pipelined_write: 0
|
||||||
|
2023/09/26-17:03:48.662561 14 Options.unordered_write: 0
|
||||||
|
2023/09/26-17:03:48.662561 14 Options.allow_concurrent_memtable_write: 1
|
||||||
|
2023/09/26-17:03:48.662562 14 Options.enable_write_thread_adaptive_yield: 1
|
||||||
|
2023/09/26-17:03:48.662563 14 Options.write_thread_max_yield_usec: 100
|
||||||
|
2023/09/26-17:03:48.662563 14 Options.write_thread_slow_yield_usec: 3
|
||||||
|
2023/09/26-17:03:48.662564 14 Options.row_cache: None
|
||||||
|
2023/09/26-17:03:48.662565 14 Options.wal_filter: None
|
||||||
|
2023/09/26-17:03:48.662567 14 Options.avoid_flush_during_recovery: 0
|
||||||
|
2023/09/26-17:03:48.662568 14 Options.allow_ingest_behind: 0
|
||||||
|
2023/09/26-17:03:48.662569 14 Options.preserve_deletes: 0
|
||||||
|
2023/09/26-17:03:48.662569 14 Options.two_write_queues: 0
|
||||||
|
2023/09/26-17:03:48.662570 14 Options.manual_wal_flush: 0
|
||||||
|
2023/09/26-17:03:48.662571 14 Options.atomic_flush: 0
|
||||||
|
2023/09/26-17:03:48.662571 14 Options.avoid_unnecessary_blocking_io: 0
|
||||||
|
2023/09/26-17:03:48.662572 14 Options.persist_stats_to_disk: 0
|
||||||
|
2023/09/26-17:03:48.662573 14 Options.write_dbid_to_manifest: 0
|
||||||
|
2023/09/26-17:03:48.662573 14 Options.log_readahead_size: 0
|
||||||
|
2023/09/26-17:03:48.662574 14 Options.file_checksum_gen_factory: Unknown
|
||||||
|
2023/09/26-17:03:48.662575 14 Options.best_efforts_recovery: 0
|
||||||
|
2023/09/26-17:03:48.662575 14 Options.max_bgerror_resume_count: 2147483647
|
||||||
|
2023/09/26-17:03:48.662576 14 Options.bgerror_resume_retry_interval: 1000000
|
||||||
|
2023/09/26-17:03:48.662577 14 Options.allow_data_in_errors: 0
|
||||||
|
2023/09/26-17:03:48.662577 14 Options.db_host_id: __hostname__
|
||||||
|
2023/09/26-17:03:48.662578 14 Options.max_background_jobs: 1
|
||||||
|
2023/09/26-17:03:48.662579 14 Options.max_background_compactions: -1
|
||||||
|
2023/09/26-17:03:48.662579 14 Options.max_subcompactions: 1
|
||||||
|
2023/09/26-17:03:48.662580 14 Options.avoid_flush_during_shutdown: 0
|
||||||
|
2023/09/26-17:03:48.662581 14 Options.writable_file_max_buffer_size: 1048576
|
||||||
|
2023/09/26-17:03:48.662581 14 Options.delayed_write_rate : 16777216
|
||||||
|
2023/09/26-17:03:48.662582 14 Options.max_total_wal_size: 0
|
||||||
|
2023/09/26-17:03:48.662583 14 Options.delete_obsolete_files_period_micros: 21600000000
|
||||||
|
2023/09/26-17:03:48.662583 14 Options.stats_dump_period_sec: 600
|
||||||
|
2023/09/26-17:03:48.662584 14 Options.stats_persist_period_sec: 600
|
||||||
|
2023/09/26-17:03:48.662585 14 Options.stats_history_buffer_size: 1048576
|
||||||
|
2023/09/26-17:03:48.662585 14 Options.max_open_files: -1
|
||||||
|
2023/09/26-17:03:48.662586 14 Options.bytes_per_sync: 0
|
||||||
|
2023/09/26-17:03:48.662587 14 Options.wal_bytes_per_sync: 0
|
||||||
|
2023/09/26-17:03:48.662587 14 Options.strict_bytes_per_sync: 0
|
||||||
|
2023/09/26-17:03:48.662588 14 Options.compaction_readahead_size: 0
|
||||||
|
2023/09/26-17:03:48.662589 14 Options.max_background_flushes: 1
|
||||||
|
2023/09/26-17:03:48.662589 14 Compression algorithms supported:
|
||||||
|
2023/09/26-17:03:48.662590 14 kZSTDNotFinalCompression supported: 1
|
||||||
|
2023/09/26-17:03:48.662591 14 kZSTD supported: 1
|
||||||
|
2023/09/26-17:03:48.662592 14 kXpressCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.662593 14 kLZ4HCCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.662593 14 kLZ4Compression supported: 0
|
||||||
|
2023/09/26-17:03:48.662594 14 kBZip2Compression supported: 0
|
||||||
|
2023/09/26-17:03:48.662595 14 kZlibCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.662595 14 kSnappyCompression supported: 0
|
||||||
|
2023/09/26-17:03:48.662597 14 Fast CRC32 supported: Supported on x86
|
||||||
|
2023/09/26-17:03:48.662771 14 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data_meta_kv/MANIFEST-000016
|
||||||
|
2023/09/26-17:03:48.663306 14 [db/column_family.cc:605] --------------- Options for column family [default]:
|
||||||
|
2023/09/26-17:03:48.663308 14 Options.comparator: leveldb.BytewiseComparator
|
||||||
|
2023/09/26-17:03:48.663309 14 Options.merge_operator: None
|
||||||
|
2023/09/26-17:03:48.663310 14 Options.compaction_filter: None
|
||||||
|
2023/09/26-17:03:48.663310 14 Options.compaction_filter_factory: None
|
||||||
|
2023/09/26-17:03:48.663311 14 Options.sst_partitioner_factory: None
|
||||||
|
2023/09/26-17:03:48.663312 14 Options.memtable_factory: SkipListFactory
|
||||||
|
2023/09/26-17:03:48.663313 14 Options.table_factory: BlockBasedTable
|
||||||
|
2023/09/26-17:03:48.663331 14 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9d208000e0)
|
||||||
|
cache_index_and_filter_blocks: 0
|
||||||
|
cache_index_and_filter_blocks_with_high_priority: 1
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache: 0
|
||||||
|
pin_top_level_index_and_filter: 1
|
||||||
|
index_type: 0
|
||||||
|
data_block_index_type: 0
|
||||||
|
index_shortening: 1
|
||||||
|
data_block_hash_table_util_ratio: 0.750000
|
||||||
|
hash_index_allow_collision: 1
|
||||||
|
checksum: 1
|
||||||
|
no_block_cache: 0
|
||||||
|
block_cache: 0x7f9d2080a010
|
||||||
|
block_cache_name: LRUCache
|
||||||
|
block_cache_options:
|
||||||
|
capacity : 2502992855
|
||||||
|
num_shard_bits : 6
|
||||||
|
strict_capacity_limit : 0
|
||||||
|
memory_allocator : None
|
||||||
|
high_pri_pool_ratio: 0.500
|
||||||
|
block_cache_compressed: (nil)
|
||||||
|
persistent_cache: (nil)
|
||||||
|
block_size: 65536
|
||||||
|
block_size_deviation: 10
|
||||||
|
block_restart_interval: 16
|
||||||
|
index_block_restart_interval: 1
|
||||||
|
metadata_block_size: 4096
|
||||||
|
partition_filters: 0
|
||||||
|
use_delta_encoding: 1
|
||||||
|
filter_policy: nullptr
|
||||||
|
whole_key_filtering: 1
|
||||||
|
verify_compression: 0
|
||||||
|
read_amp_bytes_per_bit: 0
|
||||||
|
format_version: 5
|
||||||
|
enable_index_compression: 1
|
||||||
|
block_align: 0
|
||||||
|
max_auto_readahead_size: 262144
|
||||||
|
prepopulate_block_cache: 0
|
||||||
|
2023/09/26-17:03:48.663334 14 Options.write_buffer_size: 67108864
|
||||||
|
2023/09/26-17:03:48.663335 14 Options.max_write_buffer_number: 2
|
||||||
|
2023/09/26-17:03:48.663335 14 Options.compression[0]: NoCompression
|
||||||
|
2023/09/26-17:03:48.663336 14 Options.compression[1]: ZSTD
|
||||||
|
2023/09/26-17:03:48.663337 14 Options.compression[2]: ZSTD
|
||||||
|
2023/09/26-17:03:48.663338 14 Options.bottommost_compression: Disabled
|
||||||
|
2023/09/26-17:03:48.663339 14 Options.prefix_extractor: nullptr
|
||||||
|
2023/09/26-17:03:48.663340 14 Options.memtable_insert_with_hint_prefix_extractor: nullptr
|
||||||
|
2023/09/26-17:03:48.663340 14 Options.num_levels: 3
|
||||||
|
2023/09/26-17:03:48.663341 14 Options.min_write_buffer_number_to_merge: 1
|
||||||
|
2023/09/26-17:03:48.663342 14 Options.max_write_buffer_number_to_maintain: 0
|
||||||
|
2023/09/26-17:03:48.663343 14 Options.max_write_buffer_size_to_maintain: 0
|
||||||
|
2023/09/26-17:03:48.663343 14 Options.bottommost_compression_opts.window_bits: -14
|
||||||
|
2023/09/26-17:03:48.663344 14 Options.bottommost_compression_opts.level: 32767
|
||||||
|
2023/09/26-17:03:48.663345 14 Options.bottommost_compression_opts.strategy: 0
|
||||||
|
2023/09/26-17:03:48.663346 14 Options.bottommost_compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-17:03:48.663347 14 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-17:03:48.663348 14 Options.bottommost_compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-17:03:48.663348 14 Options.bottommost_compression_opts.enabled: false
|
||||||
|
2023/09/26-17:03:48.663349 14 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-17:03:48.663350 14 Options.compression_opts.window_bits: -14
|
||||||
|
2023/09/26-17:03:48.663351 14 Options.compression_opts.level: 32767
|
||||||
|
2023/09/26-17:03:48.663352 14 Options.compression_opts.strategy: 0
|
||||||
|
2023/09/26-17:03:48.663353 14 Options.compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-17:03:48.663353 14 Options.compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-17:03:48.663354 14 Options.compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-17:03:48.663355 14 Options.compression_opts.enabled: false
|
||||||
|
2023/09/26-17:03:48.663359 14 Options.compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-17:03:48.663360 14 Options.level0_file_num_compaction_trigger: 4
|
||||||
|
2023/09/26-17:03:48.663361 14 Options.level0_slowdown_writes_trigger: 20
|
||||||
|
2023/09/26-17:03:48.663362 14 Options.level0_stop_writes_trigger: 36
|
||||||
|
2023/09/26-17:03:48.663363 14 Options.target_file_size_base: 67108864
|
||||||
|
2023/09/26-17:03:48.663363 14 Options.target_file_size_multiplier: 2
|
||||||
|
2023/09/26-17:03:48.663364 14 Options.max_bytes_for_level_base: 268435456
|
||||||
|
2023/09/26-17:03:48.663365 14 Options.level_compaction_dynamic_level_bytes: 0
|
||||||
|
2023/09/26-17:03:48.663366 14 Options.max_bytes_for_level_multiplier: 10.000000
|
||||||
|
2023/09/26-17:03:48.663368 14 Options.max_bytes_for_level_multiplier_addtl[0]: 1
|
||||||
|
2023/09/26-17:03:48.663368 14 Options.max_bytes_for_level_multiplier_addtl[1]: 1
|
||||||
|
2023/09/26-17:03:48.663369 14 Options.max_bytes_for_level_multiplier_addtl[2]: 1
|
||||||
|
2023/09/26-17:03:48.663370 14 Options.max_bytes_for_level_multiplier_addtl[3]: 1
|
||||||
|
2023/09/26-17:03:48.663371 14 Options.max_bytes_for_level_multiplier_addtl[4]: 1
|
||||||
|
2023/09/26-17:03:48.663372 14 Options.max_bytes_for_level_multiplier_addtl[5]: 1
|
||||||
|
2023/09/26-17:03:48.663372 14 Options.max_bytes_for_level_multiplier_addtl[6]: 1
|
||||||
|
2023/09/26-17:03:48.663373 14 Options.max_sequential_skip_in_iterations: 8
|
||||||
|
2023/09/26-17:03:48.663374 14 Options.max_compaction_bytes: 1677721600
|
||||||
|
2023/09/26-17:03:48.663375 14 Options.arena_block_size: 1048576
|
||||||
|
2023/09/26-17:03:48.663375 14 Options.soft_pending_compaction_bytes_limit: 68719476736
|
||||||
|
2023/09/26-17:03:48.663376 14 Options.hard_pending_compaction_bytes_limit: 274877906944
|
||||||
|
2023/09/26-17:03:48.663377 14 Options.rate_limit_delay_max_milliseconds: 100
|
||||||
|
2023/09/26-17:03:48.663378 14 Options.disable_auto_compactions: 0
|
||||||
|
2023/09/26-17:03:48.663379 14 Options.compaction_style: kCompactionStyleLevel
|
||||||
|
2023/09/26-17:03:48.663380 14 Options.compaction_pri: kMinOverlappingRatio
|
||||||
|
2023/09/26-17:03:48.663381 14 Options.compaction_options_universal.size_ratio: 1
|
||||||
|
2023/09/26-17:03:48.663382 14 Options.compaction_options_universal.min_merge_width: 2
|
||||||
|
2023/09/26-17:03:48.663382 14 Options.compaction_options_universal.max_merge_width: 4294967295
|
||||||
|
2023/09/26-17:03:48.663383 14 Options.compaction_options_universal.max_size_amplification_percent: 200
|
||||||
|
2023/09/26-17:03:48.663384 14 Options.compaction_options_universal.compression_size_percent: -1
|
||||||
|
2023/09/26-17:03:48.663385 14 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
|
||||||
|
2023/09/26-17:03:48.663386 14 Options.compaction_options_fifo.max_table_files_size: 1073741824
|
||||||
|
2023/09/26-17:03:48.663387 14 Options.compaction_options_fifo.allow_compaction: 0
|
||||||
|
2023/09/26-17:03:48.663389 14 Options.table_properties_collectors:
|
||||||
|
2023/09/26-17:03:48.663390 14 Options.inplace_update_support: 0
|
||||||
|
2023/09/26-17:03:48.663390 14 Options.inplace_update_num_locks: 10000
|
||||||
|
2023/09/26-17:03:48.663391 14 Options.memtable_prefix_bloom_size_ratio: 0.000000
|
||||||
|
2023/09/26-17:03:48.663392 14 Options.memtable_whole_key_filtering: 0
|
||||||
|
2023/09/26-17:03:48.663393 14 Options.memtable_huge_page_size: 0
|
||||||
|
2023/09/26-17:03:48.663393 14 Options.bloom_locality: 0
|
||||||
|
2023/09/26-17:03:48.663394 14 Options.max_successive_merges: 0
|
||||||
|
2023/09/26-17:03:48.663395 14 Options.optimize_filters_for_hits: 0
|
||||||
|
2023/09/26-17:03:48.663395 14 Options.paranoid_file_checks: 0
|
||||||
|
2023/09/26-17:03:48.663396 14 Options.force_consistency_checks: 1
|
||||||
|
2023/09/26-17:03:48.663397 14 Options.report_bg_io_stats: 0
|
||||||
|
2023/09/26-17:03:48.663397 14 Options.ttl: 2592000
|
||||||
|
2023/09/26-17:03:48.663398 14 Options.periodic_compaction_seconds: 0
|
||||||
|
2023/09/26-17:03:48.663399 14 Options.enable_blob_files: false
|
||||||
|
2023/09/26-17:03:48.663401 14 Options.min_blob_size: 0
|
||||||
|
2023/09/26-17:03:48.663402 14 Options.blob_file_size: 268435456
|
||||||
|
2023/09/26-17:03:48.663403 14 Options.blob_compression_type: NoCompression
|
||||||
|
2023/09/26-17:03:48.663404 14 Options.enable_blob_garbage_collection: false
|
||||||
|
2023/09/26-17:03:48.663404 14 Options.blob_garbage_collection_age_cutoff: 0.250000
|
||||||
|
2023/09/26-17:03:48.663405 14 Options.blob_garbage_collection_force_threshold: 1.000000
|
||||||
|
2023/09/26-17:03:48.663406 14 Options.blob_compaction_readahead_size: 0
|
||||||
|
2023/09/26-17:03:48.664513 14 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data_meta_kv/MANIFEST-000016 succeeded,manifest_file_number is 16, next_file_number is 18, last_sequence is 72567, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
|
||||||
|
2023/09/26-17:03:48.664517 14 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 12
|
||||||
|
2023/09/26-17:03:48.664691 14 [db/version_set.cc:4384] Creating manifest 20
|
||||||
|
2023/09/26-17:03:48.668593 14 EVENT_LOG_v1 {"time_micros": 1695747828668585, "job": 1, "event": "recovery_started", "wal_files": [17]}
|
||||||
|
2023/09/26-17:03:48.668596 14 [db/db_impl/db_impl_open.cc:883] Recovering log #17 mode 2
|
||||||
|
2023/09/26-17:03:48.691746 14 EVENT_LOG_v1 {"time_micros": 1695747828691727, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 21, "file_size": 1100, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 159, "index_size": 24, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 156, "raw_average_key_size": 39, "raw_value_size": 29, "raw_average_value_size": 7, "num_data_blocks": 1, "num_entries": 4, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695747828, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf0fe53a-7182-458f-baa9-e07d3ffe5860", "db_session_id": "345C9WGIGWXHNGD85BUM", "orig_file_number": 21}}
|
||||||
|
2023/09/26-17:03:48.691768 14 [db/version_set.cc:4384] Creating manifest 22
|
||||||
|
2023/09/26-17:03:48.698062 14 EVENT_LOG_v1 {"time_micros": 1695747828698061, "job": 1, "event": "recovery_finished"}
|
||||||
|
2023/09/26-17:03:48.701551 14 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data_meta_kv/000017.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
|
||||||
|
2023/09/26-17:03:48.701562 14 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9d20855000
|
||||||
|
2023/09/26-17:03:48.701580 14 DB pointer 0x7f9d20839000
|
||||||
|
2023/09/26-17:03:48.701758 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:03:48.701772 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 0.0 total, 0.0 interval
|
||||||
|
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 0.0 total, 0.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 1 last_copies: 0 last_secs: 2.9e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-17:13:48.702139 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:13:48.702207 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 600.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 7017 writes, 7017 keys, 7016 commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 7017 writes, 0 syncs, 7017.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7017 writes, 7017 keys, 7016 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7017 writes, 0 syncs, 7017.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 600.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 2 last_copies: 0 last_secs: 9.2e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-17:23:48.702567 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:23:48.702636 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1200.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 14K writes, 0 syncs, 14217.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1200.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 3 last_copies: 0 last_secs: 9e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-17:33:48.703140 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-17:33:48.703205 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1800.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 21K writes, 0 syncs, 21417.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1800.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 4 last_copies: 0 last_secs: 0.000227 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
|
@ -0,0 +1,815 @@
|
||||||
|
2023/09/26-09:25:26.684985 17 RocksDB version: 6.27.3
|
||||||
|
2023/09/26-09:25:26.685027 17 Git sha 0
|
||||||
|
2023/09/26-09:25:26.685028 17 Compile date 2023-06-14 04:09:40
|
||||||
|
2023/09/26-09:25:26.685031 17 DB SUMMARY
|
||||||
|
2023/09/26-09:25:26.685032 17 DB Session ID: 6O2QNLLK9Q04IJ9PYGWV
|
||||||
|
2023/09/26-09:25:26.685050 17 CURRENT file: CURRENT
|
||||||
|
2023/09/26-09:25:26.685051 17 IDENTITY file: IDENTITY
|
||||||
|
2023/09/26-09:25:26.685054 17 MANIFEST file: MANIFEST-000004 size: 57 Bytes
|
||||||
|
2023/09/26-09:25:26.685055 17 SST files in /var/lib/milvus/rdb_data_meta_kv dir, Total Num: 0, files:
|
||||||
|
2023/09/26-09:25:26.685056 17 Write Ahead Log file in /var/lib/milvus/rdb_data_meta_kv: 000005.log size: 9661 ;
|
||||||
|
2023/09/26-09:25:26.685057 17 Options.error_if_exists: 0
|
||||||
|
2023/09/26-09:25:26.685058 17 Options.create_if_missing: 1
|
||||||
|
2023/09/26-09:25:26.685059 17 Options.paranoid_checks: 1
|
||||||
|
2023/09/26-09:25:26.685059 17 Options.flush_verify_memtable_count: 1
|
||||||
|
2023/09/26-09:25:26.685060 17 Options.track_and_verify_wals_in_manifest: 0
|
||||||
|
2023/09/26-09:25:26.685061 17 Options.env: 0x5e1d140
|
||||||
|
2023/09/26-09:25:26.685062 17 Options.fs: PosixFileSystem
|
||||||
|
2023/09/26-09:25:26.685063 17 Options.info_log: 0x7f9133a1a0a0
|
||||||
|
2023/09/26-09:25:26.685063 17 Options.max_file_opening_threads: 16
|
||||||
|
2023/09/26-09:25:26.685064 17 Options.statistics: (nil)
|
||||||
|
2023/09/26-09:25:26.685065 17 Options.use_fsync: 0
|
||||||
|
2023/09/26-09:25:26.685065 17 Options.max_log_file_size: 0
|
||||||
|
2023/09/26-09:25:26.685066 17 Options.max_manifest_file_size: 1073741824
|
||||||
|
2023/09/26-09:25:26.685067 17 Options.log_file_time_to_roll: 0
|
||||||
|
2023/09/26-09:25:26.685068 17 Options.keep_log_file_num: 1000
|
||||||
|
2023/09/26-09:25:26.685068 17 Options.recycle_log_file_num: 0
|
||||||
|
2023/09/26-09:25:26.685069 17 Options.allow_fallocate: 1
|
||||||
|
2023/09/26-09:25:26.685070 17 Options.allow_mmap_reads: 0
|
||||||
|
2023/09/26-09:25:26.685070 17 Options.allow_mmap_writes: 0
|
||||||
|
2023/09/26-09:25:26.685071 17 Options.use_direct_reads: 0
|
||||||
|
2023/09/26-09:25:26.685072 17 Options.use_direct_io_for_flush_and_compaction: 0
|
||||||
|
2023/09/26-09:25:26.685072 17 Options.create_missing_column_families: 0
|
||||||
|
2023/09/26-09:25:26.685073 17 Options.db_log_dir:
|
||||||
|
2023/09/26-09:25:26.685074 17 Options.wal_dir:
|
||||||
|
2023/09/26-09:25:26.685074 17 Options.table_cache_numshardbits: 6
|
||||||
|
2023/09/26-09:25:26.685075 17 Options.WAL_ttl_seconds: 0
|
||||||
|
2023/09/26-09:25:26.685076 17 Options.WAL_size_limit_MB: 0
|
||||||
|
2023/09/26-09:25:26.685076 17 Options.max_write_batch_group_size_bytes: 1048576
|
||||||
|
2023/09/26-09:25:26.685077 17 Options.manifest_preallocation_size: 4194304
|
||||||
|
2023/09/26-09:25:26.685078 17 Options.is_fd_close_on_exec: 1
|
||||||
|
2023/09/26-09:25:26.685078 17 Options.advise_random_on_open: 1
|
||||||
|
2023/09/26-09:25:26.685079 17 Options.experimental_mempurge_threshold: 0.000000
|
||||||
|
2023/09/26-09:25:26.685088 17 Options.db_write_buffer_size: 0
|
||||||
|
2023/09/26-09:25:26.685089 17 Options.write_buffer_manager: 0x7f9133a250a0
|
||||||
|
2023/09/26-09:25:26.685089 17 Options.access_hint_on_compaction_start: 1
|
||||||
|
2023/09/26-09:25:26.685090 17 Options.new_table_reader_for_compaction_inputs: 0
|
||||||
|
2023/09/26-09:25:26.685091 17 Options.random_access_max_buffer_size: 1048576
|
||||||
|
2023/09/26-09:25:26.685091 17 Options.use_adaptive_mutex: 0
|
||||||
|
2023/09/26-09:25:26.685092 17 Options.rate_limiter: (nil)
|
||||||
|
2023/09/26-09:25:26.685093 17 Options.sst_file_manager.rate_bytes_per_sec: 0
|
||||||
|
2023/09/26-09:25:26.685094 17 Options.wal_recovery_mode: 2
|
||||||
|
2023/09/26-09:25:26.685101 17 Options.enable_thread_tracking: 0
|
||||||
|
2023/09/26-09:25:26.685102 17 Options.enable_pipelined_write: 0
|
||||||
|
2023/09/26-09:25:26.685102 17 Options.unordered_write: 0
|
||||||
|
2023/09/26-09:25:26.685103 17 Options.allow_concurrent_memtable_write: 1
|
||||||
|
2023/09/26-09:25:26.685104 17 Options.enable_write_thread_adaptive_yield: 1
|
||||||
|
2023/09/26-09:25:26.685104 17 Options.write_thread_max_yield_usec: 100
|
||||||
|
2023/09/26-09:25:26.685105 17 Options.write_thread_slow_yield_usec: 3
|
||||||
|
2023/09/26-09:25:26.685106 17 Options.row_cache: None
|
||||||
|
2023/09/26-09:25:26.685106 17 Options.wal_filter: None
|
||||||
|
2023/09/26-09:25:26.685109 17 Options.avoid_flush_during_recovery: 0
|
||||||
|
2023/09/26-09:25:26.685110 17 Options.allow_ingest_behind: 0
|
||||||
|
2023/09/26-09:25:26.685110 17 Options.preserve_deletes: 0
|
||||||
|
2023/09/26-09:25:26.685111 17 Options.two_write_queues: 0
|
||||||
|
2023/09/26-09:25:26.685112 17 Options.manual_wal_flush: 0
|
||||||
|
2023/09/26-09:25:26.685112 17 Options.atomic_flush: 0
|
||||||
|
2023/09/26-09:25:26.685113 17 Options.avoid_unnecessary_blocking_io: 0
|
||||||
|
2023/09/26-09:25:26.685114 17 Options.persist_stats_to_disk: 0
|
||||||
|
2023/09/26-09:25:26.685114 17 Options.write_dbid_to_manifest: 0
|
||||||
|
2023/09/26-09:25:26.685115 17 Options.log_readahead_size: 0
|
||||||
|
2023/09/26-09:25:26.685116 17 Options.file_checksum_gen_factory: Unknown
|
||||||
|
2023/09/26-09:25:26.685116 17 Options.best_efforts_recovery: 0
|
||||||
|
2023/09/26-09:25:26.685117 17 Options.max_bgerror_resume_count: 2147483647
|
||||||
|
2023/09/26-09:25:26.685118 17 Options.bgerror_resume_retry_interval: 1000000
|
||||||
|
2023/09/26-09:25:26.685119 17 Options.allow_data_in_errors: 0
|
||||||
|
2023/09/26-09:25:26.685119 17 Options.db_host_id: __hostname__
|
||||||
|
2023/09/26-09:25:26.685120 17 Options.max_background_jobs: 1
|
||||||
|
2023/09/26-09:25:26.685120 17 Options.max_background_compactions: -1
|
||||||
|
2023/09/26-09:25:26.685121 17 Options.max_subcompactions: 1
|
||||||
|
2023/09/26-09:25:26.685122 17 Options.avoid_flush_during_shutdown: 0
|
||||||
|
2023/09/26-09:25:26.685123 17 Options.writable_file_max_buffer_size: 1048576
|
||||||
|
2023/09/26-09:25:26.685123 17 Options.delayed_write_rate : 16777216
|
||||||
|
2023/09/26-09:25:26.685124 17 Options.max_total_wal_size: 0
|
||||||
|
2023/09/26-09:25:26.685125 17 Options.delete_obsolete_files_period_micros: 21600000000
|
||||||
|
2023/09/26-09:25:26.685125 17 Options.stats_dump_period_sec: 600
|
||||||
|
2023/09/26-09:25:26.685126 17 Options.stats_persist_period_sec: 600
|
||||||
|
2023/09/26-09:25:26.685127 17 Options.stats_history_buffer_size: 1048576
|
||||||
|
2023/09/26-09:25:26.685127 17 Options.max_open_files: -1
|
||||||
|
2023/09/26-09:25:26.685128 17 Options.bytes_per_sync: 0
|
||||||
|
2023/09/26-09:25:26.685129 17 Options.wal_bytes_per_sync: 0
|
||||||
|
2023/09/26-09:25:26.685129 17 Options.strict_bytes_per_sync: 0
|
||||||
|
2023/09/26-09:25:26.685130 17 Options.compaction_readahead_size: 0
|
||||||
|
2023/09/26-09:25:26.685131 17 Options.max_background_flushes: 1
|
||||||
|
2023/09/26-09:25:26.685131 17 Compression algorithms supported:
|
||||||
|
2023/09/26-09:25:26.685132 17 kZSTDNotFinalCompression supported: 1
|
||||||
|
2023/09/26-09:25:26.685133 17 kZSTD supported: 1
|
||||||
|
2023/09/26-09:25:26.685134 17 kXpressCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.685135 17 kLZ4HCCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.685135 17 kLZ4Compression supported: 0
|
||||||
|
2023/09/26-09:25:26.685136 17 kBZip2Compression supported: 0
|
||||||
|
2023/09/26-09:25:26.685137 17 kZlibCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.685137 17 kSnappyCompression supported: 0
|
||||||
|
2023/09/26-09:25:26.685139 17 Fast CRC32 supported: Supported on x86
|
||||||
|
2023/09/26-09:25:26.685174 17 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data_meta_kv/MANIFEST-000004
|
||||||
|
2023/09/26-09:25:26.685282 17 [db/column_family.cc:605] --------------- Options for column family [default]:
|
||||||
|
2023/09/26-09:25:26.685283 17 Options.comparator: leveldb.BytewiseComparator
|
||||||
|
2023/09/26-09:25:26.685284 17 Options.merge_operator: None
|
||||||
|
2023/09/26-09:25:26.685285 17 Options.compaction_filter: None
|
||||||
|
2023/09/26-09:25:26.685286 17 Options.compaction_filter_factory: None
|
||||||
|
2023/09/26-09:25:26.685286 17 Options.sst_partitioner_factory: None
|
||||||
|
2023/09/26-09:25:26.685287 17 Options.memtable_factory: SkipListFactory
|
||||||
|
2023/09/26-09:25:26.685288 17 Options.table_factory: BlockBasedTable
|
||||||
|
2023/09/26-09:25:26.685304 17 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9133a14160)
|
||||||
|
cache_index_and_filter_blocks: 0
|
||||||
|
cache_index_and_filter_blocks_with_high_priority: 1
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache: 0
|
||||||
|
pin_top_level_index_and_filter: 1
|
||||||
|
index_type: 0
|
||||||
|
data_block_index_type: 0
|
||||||
|
index_shortening: 1
|
||||||
|
data_block_hash_table_util_ratio: 0.750000
|
||||||
|
hash_index_allow_collision: 1
|
||||||
|
checksum: 1
|
||||||
|
no_block_cache: 0
|
||||||
|
block_cache: 0x7f9133a25010
|
||||||
|
block_cache_name: LRUCache
|
||||||
|
block_cache_options:
|
||||||
|
capacity : 2502992855
|
||||||
|
num_shard_bits : 6
|
||||||
|
strict_capacity_limit : 0
|
||||||
|
memory_allocator : None
|
||||||
|
high_pri_pool_ratio: 0.500
|
||||||
|
block_cache_compressed: (nil)
|
||||||
|
persistent_cache: (nil)
|
||||||
|
block_size: 65536
|
||||||
|
block_size_deviation: 10
|
||||||
|
block_restart_interval: 16
|
||||||
|
index_block_restart_interval: 1
|
||||||
|
metadata_block_size: 4096
|
||||||
|
partition_filters: 0
|
||||||
|
use_delta_encoding: 1
|
||||||
|
filter_policy: nullptr
|
||||||
|
whole_key_filtering: 1
|
||||||
|
verify_compression: 0
|
||||||
|
read_amp_bytes_per_bit: 0
|
||||||
|
format_version: 5
|
||||||
|
enable_index_compression: 1
|
||||||
|
block_align: 0
|
||||||
|
max_auto_readahead_size: 262144
|
||||||
|
prepopulate_block_cache: 0
|
||||||
|
2023/09/26-09:25:26.685307 17 Options.write_buffer_size: 67108864
|
||||||
|
2023/09/26-09:25:26.685308 17 Options.max_write_buffer_number: 2
|
||||||
|
2023/09/26-09:25:26.685309 17 Options.compression[0]: NoCompression
|
||||||
|
2023/09/26-09:25:26.685309 17 Options.compression[1]: ZSTD
|
||||||
|
2023/09/26-09:25:26.685310 17 Options.compression[2]: ZSTD
|
||||||
|
2023/09/26-09:25:26.685311 17 Options.bottommost_compression: Disabled
|
||||||
|
2023/09/26-09:25:26.685312 17 Options.prefix_extractor: nullptr
|
||||||
|
2023/09/26-09:25:26.685312 17 Options.memtable_insert_with_hint_prefix_extractor: nullptr
|
||||||
|
2023/09/26-09:25:26.685313 17 Options.num_levels: 3
|
||||||
|
2023/09/26-09:25:26.685314 17 Options.min_write_buffer_number_to_merge: 1
|
||||||
|
2023/09/26-09:25:26.685314 17 Options.max_write_buffer_number_to_maintain: 0
|
||||||
|
2023/09/26-09:25:26.685315 17 Options.max_write_buffer_size_to_maintain: 0
|
||||||
|
2023/09/26-09:25:26.685316 17 Options.bottommost_compression_opts.window_bits: -14
|
||||||
|
2023/09/26-09:25:26.685316 17 Options.bottommost_compression_opts.level: 32767
|
||||||
|
2023/09/26-09:25:26.685317 17 Options.bottommost_compression_opts.strategy: 0
|
||||||
|
2023/09/26-09:25:26.685318 17 Options.bottommost_compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-09:25:26.685318 17 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-09:25:26.685319 17 Options.bottommost_compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-09:25:26.685320 17 Options.bottommost_compression_opts.enabled: false
|
||||||
|
2023/09/26-09:25:26.685320 17 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-09:25:26.685321 17 Options.compression_opts.window_bits: -14
|
||||||
|
2023/09/26-09:25:26.685322 17 Options.compression_opts.level: 32767
|
||||||
|
2023/09/26-09:25:26.685322 17 Options.compression_opts.strategy: 0
|
||||||
|
2023/09/26-09:25:26.685323 17 Options.compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-09:25:26.685324 17 Options.compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-09:25:26.685324 17 Options.compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-09:25:26.685325 17 Options.compression_opts.enabled: false
|
||||||
|
2023/09/26-09:25:26.685325 17 Options.compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-09:25:26.685330 17 Options.level0_file_num_compaction_trigger: 4
|
||||||
|
2023/09/26-09:25:26.685331 17 Options.level0_slowdown_writes_trigger: 20
|
||||||
|
2023/09/26-09:25:26.685332 17 Options.level0_stop_writes_trigger: 36
|
||||||
|
2023/09/26-09:25:26.685332 17 Options.target_file_size_base: 67108864
|
||||||
|
2023/09/26-09:25:26.685333 17 Options.target_file_size_multiplier: 2
|
||||||
|
2023/09/26-09:25:26.685334 17 Options.max_bytes_for_level_base: 268435456
|
||||||
|
2023/09/26-09:25:26.685334 17 Options.level_compaction_dynamic_level_bytes: 0
|
||||||
|
2023/09/26-09:25:26.685335 17 Options.max_bytes_for_level_multiplier: 10.000000
|
||||||
|
2023/09/26-09:25:26.685337 17 Options.max_bytes_for_level_multiplier_addtl[0]: 1
|
||||||
|
2023/09/26-09:25:26.685337 17 Options.max_bytes_for_level_multiplier_addtl[1]: 1
|
||||||
|
2023/09/26-09:25:26.685338 17 Options.max_bytes_for_level_multiplier_addtl[2]: 1
|
||||||
|
2023/09/26-09:25:26.685339 17 Options.max_bytes_for_level_multiplier_addtl[3]: 1
|
||||||
|
2023/09/26-09:25:26.685339 17 Options.max_bytes_for_level_multiplier_addtl[4]: 1
|
||||||
|
2023/09/26-09:25:26.685340 17 Options.max_bytes_for_level_multiplier_addtl[5]: 1
|
||||||
|
2023/09/26-09:25:26.685341 17 Options.max_bytes_for_level_multiplier_addtl[6]: 1
|
||||||
|
2023/09/26-09:25:26.685341 17 Options.max_sequential_skip_in_iterations: 8
|
||||||
|
2023/09/26-09:25:26.685342 17 Options.max_compaction_bytes: 1677721600
|
||||||
|
2023/09/26-09:25:26.685343 17 Options.arena_block_size: 1048576
|
||||||
|
2023/09/26-09:25:26.685343 17 Options.soft_pending_compaction_bytes_limit: 68719476736
|
||||||
|
2023/09/26-09:25:26.685344 17 Options.hard_pending_compaction_bytes_limit: 274877906944
|
||||||
|
2023/09/26-09:25:26.685345 17 Options.rate_limit_delay_max_milliseconds: 100
|
||||||
|
2023/09/26-09:25:26.685345 17 Options.disable_auto_compactions: 0
|
||||||
|
2023/09/26-09:25:26.685347 17 Options.compaction_style: kCompactionStyleLevel
|
||||||
|
2023/09/26-09:25:26.685348 17 Options.compaction_pri: kMinOverlappingRatio
|
||||||
|
2023/09/26-09:25:26.685348 17 Options.compaction_options_universal.size_ratio: 1
|
||||||
|
2023/09/26-09:25:26.685349 17 Options.compaction_options_universal.min_merge_width: 2
|
||||||
|
2023/09/26-09:25:26.685350 17 Options.compaction_options_universal.max_merge_width: 4294967295
|
||||||
|
2023/09/26-09:25:26.685350 17 Options.compaction_options_universal.max_size_amplification_percent: 200
|
||||||
|
2023/09/26-09:25:26.685351 17 Options.compaction_options_universal.compression_size_percent: -1
|
||||||
|
2023/09/26-09:25:26.685352 17 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
|
||||||
|
2023/09/26-09:25:26.685352 17 Options.compaction_options_fifo.max_table_files_size: 1073741824
|
||||||
|
2023/09/26-09:25:26.685353 17 Options.compaction_options_fifo.allow_compaction: 0
|
||||||
|
2023/09/26-09:25:26.685355 17 Options.table_properties_collectors:
|
||||||
|
2023/09/26-09:25:26.685356 17 Options.inplace_update_support: 0
|
||||||
|
2023/09/26-09:25:26.685356 17 Options.inplace_update_num_locks: 10000
|
||||||
|
2023/09/26-09:25:26.685357 17 Options.memtable_prefix_bloom_size_ratio: 0.000000
|
||||||
|
2023/09/26-09:25:26.685358 17 Options.memtable_whole_key_filtering: 0
|
||||||
|
2023/09/26-09:25:26.685358 17 Options.memtable_huge_page_size: 0
|
||||||
|
2023/09/26-09:25:26.685359 17 Options.bloom_locality: 0
|
||||||
|
2023/09/26-09:25:26.685360 17 Options.max_successive_merges: 0
|
||||||
|
2023/09/26-09:25:26.685360 17 Options.optimize_filters_for_hits: 0
|
||||||
|
2023/09/26-09:25:26.685361 17 Options.paranoid_file_checks: 0
|
||||||
|
2023/09/26-09:25:26.685362 17 Options.force_consistency_checks: 1
|
||||||
|
2023/09/26-09:25:26.685362 17 Options.report_bg_io_stats: 0
|
||||||
|
2023/09/26-09:25:26.685363 17 Options.ttl: 2592000
|
||||||
|
2023/09/26-09:25:26.685364 17 Options.periodic_compaction_seconds: 0
|
||||||
|
2023/09/26-09:25:26.685364 17 Options.enable_blob_files: false
|
||||||
|
2023/09/26-09:25:26.685365 17 Options.min_blob_size: 0
|
||||||
|
2023/09/26-09:25:26.685368 17 Options.blob_file_size: 268435456
|
||||||
|
2023/09/26-09:25:26.685369 17 Options.blob_compression_type: NoCompression
|
||||||
|
2023/09/26-09:25:26.685369 17 Options.enable_blob_garbage_collection: false
|
||||||
|
2023/09/26-09:25:26.685370 17 Options.blob_garbage_collection_age_cutoff: 0.250000
|
||||||
|
2023/09/26-09:25:26.685371 17 Options.blob_garbage_collection_force_threshold: 1.000000
|
||||||
|
2023/09/26-09:25:26.685372 17 Options.blob_compaction_readahead_size: 0
|
||||||
|
2023/09/26-09:25:26.686196 17 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data_meta_kv/MANIFEST-000004 succeeded,manifest_file_number is 4, next_file_number is 6, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
|
||||||
|
2023/09/26-09:25:26.686201 17 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 0
|
||||||
|
2023/09/26-09:25:26.686251 17 [db/version_set.cc:4384] Creating manifest 8
|
||||||
|
2023/09/26-09:25:26.690221 17 EVENT_LOG_v1 {"time_micros": 1695720326690213, "job": 1, "event": "recovery_started", "wal_files": [5]}
|
||||||
|
2023/09/26-09:25:26.690225 17 [db/db_impl/db_impl_open.cc:883] Recovering log #5 mode 2
|
||||||
|
2023/09/26-09:25:26.691812 17 EVENT_LOG_v1 {"time_micros": 1695720326691796, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 9, "file_size": 1839, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 872, "index_size": 49, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 1528, "raw_average_key_size": 41, "raw_value_size": 214, "raw_average_value_size": 5, "num_data_blocks": 1, "num_entries": 37, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695720326, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf0fe53a-7182-458f-baa9-e07d3ffe5860", "db_session_id": "6O2QNLLK9Q04IJ9PYGWV", "orig_file_number": 9}}
|
||||||
|
2023/09/26-09:25:26.691837 17 [db/version_set.cc:4384] Creating manifest 10
|
||||||
|
2023/09/26-09:25:26.695848 17 EVENT_LOG_v1 {"time_micros": 1695720326695845, "job": 1, "event": "recovery_finished"}
|
||||||
|
2023/09/26-09:25:26.699163 17 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data_meta_kv/000005.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
|
||||||
|
2023/09/26-09:25:26.699226 17 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9133a5b000
|
||||||
|
2023/09/26-09:25:26.699252 17 DB pointer 0x7f9133a46000
|
||||||
|
2023/09/26-09:25:26.699517 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:25:26.699527 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 0.0 total, 0.0 interval
|
||||||
|
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 0.0 total, 0.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 1 last_copies: 0 last_secs: 3.4e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-09:35:26.699700 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:35:26.699721 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 600.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 4247 writes, 4248 keys, 4247 commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 4247 writes, 0 syncs, 4247.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 4247 writes, 4248 keys, 4247 commit groups, 1.0 writes per commit group, ingest: 0.23 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 4247 writes, 0 syncs, 4247.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 600.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 2 last_copies: 0 last_secs: 4.2e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-09:45:26.700102 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:45:26.700171 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1200.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 11K writes, 11K keys, 11K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 11K writes, 0 syncs, 11442.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7195 writes, 7195 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7195 writes, 0 syncs, 7195.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1200.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 3 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-09:55:26.700345 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-09:55:26.700375 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1800.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 18K writes, 18K keys, 18K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 18K writes, 0 syncs, 18640.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7198 writes, 7198 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1800.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 4 last_copies: 0 last_secs: 3.5e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:05:26.700585 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:05:26.700609 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 2400.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 25K writes, 25K keys, 25K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 25K writes, 0 syncs, 25836.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7196 writes, 7196 keys, 7196 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7196 writes, 0 syncs, 7196.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 2400.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 5 last_copies: 0 last_secs: 3.4e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:15:26.700962 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:15:26.701033 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3000.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 33K writes, 33K keys, 33K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 33K writes, 0 syncs, 33035.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7199 writes, 7199 keys, 7199 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3000.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 6 last_copies: 0 last_secs: 9.2e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:25:26.701396 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:25:26.701466 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3600.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 40K writes, 40K keys, 40K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 40K writes, 0 syncs, 40235.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3600.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 7 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:35:26.701836 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:35:26.701904 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 4200.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 47K writes, 47K keys, 47K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 47K writes, 0 syncs, 47434.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7199 writes, 7199 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 4200.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 8 last_copies: 0 last_secs: 8.9e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:45:26.702269 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:45:26.702338 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 4800.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 54K writes, 54K keys, 54K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 54K writes, 0 syncs, 54632.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7198 writes, 7198 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 4800.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 9 last_copies: 0 last_secs: 9e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-10:55:26.702526 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-10:55:26.702554 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 5400.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 61K writes, 61K keys, 61K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 61K writes, 0 syncs, 61832.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 5400.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 10 last_copies: 0 last_secs: 4.3e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:05:26.702919 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:05:26.703004 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 6000.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 69K writes, 69K keys, 69K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 69K writes, 0 syncs, 69032.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7200 writes, 7200 keys, 7199 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 6000.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 11 last_copies: 0 last_secs: 8.9e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:15:26.703189 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:15:26.703225 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 6600.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 3373 writes, 3373 keys, 3372 commit groups, 1.0 writes per commit group, ingest: 0.19 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 3373 writes, 0 syncs, 3373.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 6600.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 12 last_copies: 0 last_secs: 3.6e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:25:26.703594 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:25:26.703671 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 7200.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 7200.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 13 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:35:26.703985 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:35:26.704044 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 7800.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 7800.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 14 last_copies: 0 last_secs: 7.7e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:45:26.704427 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:45:26.704498 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 8400.0 total, 600.0 interval
|
||||||
|
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 8400.0 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 15 last_copies: 0 last_secs: 9.6e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-11:54:32.182086 7 [db/db_impl/db_impl.cc:472] Shutdown: canceling all background work
|
||||||
|
2023/09/26-11:54:32.182303 7 [db/db_impl/db_impl.cc:685] Shutdown complete
|
|
@ -0,0 +1,509 @@
|
||||||
|
2023/09/26-11:55:44.006969 16 RocksDB version: 6.27.3
|
||||||
|
2023/09/26-11:55:44.007031 16 Git sha 0
|
||||||
|
2023/09/26-11:55:44.007034 16 Compile date 2023-06-14 04:09:40
|
||||||
|
2023/09/26-11:55:44.007038 16 DB SUMMARY
|
||||||
|
2023/09/26-11:55:44.007039 16 DB Session ID: LDJPBRCKW95VBBDOA0BC
|
||||||
|
2023/09/26-11:55:44.007064 16 CURRENT file: CURRENT
|
||||||
|
2023/09/26-11:55:44.007066 16 IDENTITY file: IDENTITY
|
||||||
|
2023/09/26-11:55:44.007071 16 MANIFEST file: MANIFEST-000010 size: 185 Bytes
|
||||||
|
2023/09/26-11:55:44.007073 16 SST files in /var/lib/milvus/rdb_data_meta_kv dir, Total Num: 1, files: 000009.sst
|
||||||
|
2023/09/26-11:55:44.007075 16 Write Ahead Log file in /var/lib/milvus/rdb_data_meta_kv: 000011.log size: 4800444 ;
|
||||||
|
2023/09/26-11:55:44.007077 16 Options.error_if_exists: 0
|
||||||
|
2023/09/26-11:55:44.007079 16 Options.create_if_missing: 1
|
||||||
|
2023/09/26-11:55:44.007080 16 Options.paranoid_checks: 1
|
||||||
|
2023/09/26-11:55:44.007081 16 Options.flush_verify_memtable_count: 1
|
||||||
|
2023/09/26-11:55:44.007083 16 Options.track_and_verify_wals_in_manifest: 0
|
||||||
|
2023/09/26-11:55:44.007084 16 Options.env: 0x5e1d140
|
||||||
|
2023/09/26-11:55:44.007086 16 Options.fs: PosixFileSystem
|
||||||
|
2023/09/26-11:55:44.007088 16 Options.info_log: 0x7f9f31e4e050
|
||||||
|
2023/09/26-11:55:44.007089 16 Options.max_file_opening_threads: 16
|
||||||
|
2023/09/26-11:55:44.007091 16 Options.statistics: (nil)
|
||||||
|
2023/09/26-11:55:44.007093 16 Options.use_fsync: 0
|
||||||
|
2023/09/26-11:55:44.007094 16 Options.max_log_file_size: 0
|
||||||
|
2023/09/26-11:55:44.007095 16 Options.max_manifest_file_size: 1073741824
|
||||||
|
2023/09/26-11:55:44.007097 16 Options.log_file_time_to_roll: 0
|
||||||
|
2023/09/26-11:55:44.007098 16 Options.keep_log_file_num: 1000
|
||||||
|
2023/09/26-11:55:44.007100 16 Options.recycle_log_file_num: 0
|
||||||
|
2023/09/26-11:55:44.007101 16 Options.allow_fallocate: 1
|
||||||
|
2023/09/26-11:55:44.007102 16 Options.allow_mmap_reads: 0
|
||||||
|
2023/09/26-11:55:44.007104 16 Options.allow_mmap_writes: 0
|
||||||
|
2023/09/26-11:55:44.007105 16 Options.use_direct_reads: 0
|
||||||
|
2023/09/26-11:55:44.007106 16 Options.use_direct_io_for_flush_and_compaction: 0
|
||||||
|
2023/09/26-11:55:44.007108 16 Options.create_missing_column_families: 0
|
||||||
|
2023/09/26-11:55:44.007109 16 Options.db_log_dir:
|
||||||
|
2023/09/26-11:55:44.007111 16 Options.wal_dir:
|
||||||
|
2023/09/26-11:55:44.007112 16 Options.table_cache_numshardbits: 6
|
||||||
|
2023/09/26-11:55:44.007114 16 Options.WAL_ttl_seconds: 0
|
||||||
|
2023/09/26-11:55:44.007115 16 Options.WAL_size_limit_MB: 0
|
||||||
|
2023/09/26-11:55:44.007116 16 Options.max_write_batch_group_size_bytes: 1048576
|
||||||
|
2023/09/26-11:55:44.007118 16 Options.manifest_preallocation_size: 4194304
|
||||||
|
2023/09/26-11:55:44.007119 16 Options.is_fd_close_on_exec: 1
|
||||||
|
2023/09/26-11:55:44.007120 16 Options.advise_random_on_open: 1
|
||||||
|
2023/09/26-11:55:44.007122 16 Options.experimental_mempurge_threshold: 0.000000
|
||||||
|
2023/09/26-11:55:44.007130 16 Options.db_write_buffer_size: 0
|
||||||
|
2023/09/26-11:55:44.007131 16 Options.write_buffer_manager: 0x7f9f31e0a0a0
|
||||||
|
2023/09/26-11:55:44.007133 16 Options.access_hint_on_compaction_start: 1
|
||||||
|
2023/09/26-11:55:44.007134 16 Options.new_table_reader_for_compaction_inputs: 0
|
||||||
|
2023/09/26-11:55:44.007136 16 Options.random_access_max_buffer_size: 1048576
|
||||||
|
2023/09/26-11:55:44.007137 16 Options.use_adaptive_mutex: 0
|
||||||
|
2023/09/26-11:55:44.007138 16 Options.rate_limiter: (nil)
|
||||||
|
2023/09/26-11:55:44.007140 16 Options.sst_file_manager.rate_bytes_per_sec: 0
|
||||||
|
2023/09/26-11:55:44.007142 16 Options.wal_recovery_mode: 2
|
||||||
|
2023/09/26-11:55:44.007149 16 Options.enable_thread_tracking: 0
|
||||||
|
2023/09/26-11:55:44.007151 16 Options.enable_pipelined_write: 0
|
||||||
|
2023/09/26-11:55:44.007152 16 Options.unordered_write: 0
|
||||||
|
2023/09/26-11:55:44.007153 16 Options.allow_concurrent_memtable_write: 1
|
||||||
|
2023/09/26-11:55:44.007154 16 Options.enable_write_thread_adaptive_yield: 1
|
||||||
|
2023/09/26-11:55:44.007156 16 Options.write_thread_max_yield_usec: 100
|
||||||
|
2023/09/26-11:55:44.007157 16 Options.write_thread_slow_yield_usec: 3
|
||||||
|
2023/09/26-11:55:44.007159 16 Options.row_cache: None
|
||||||
|
2023/09/26-11:55:44.007160 16 Options.wal_filter: None
|
||||||
|
2023/09/26-11:55:44.007247 16 Options.avoid_flush_during_recovery: 0
|
||||||
|
2023/09/26-11:55:44.007249 16 Options.allow_ingest_behind: 0
|
||||||
|
2023/09/26-11:55:44.007250 16 Options.preserve_deletes: 0
|
||||||
|
2023/09/26-11:55:44.007251 16 Options.two_write_queues: 0
|
||||||
|
2023/09/26-11:55:44.007252 16 Options.manual_wal_flush: 0
|
||||||
|
2023/09/26-11:55:44.007253 16 Options.atomic_flush: 0
|
||||||
|
2023/09/26-11:55:44.007254 16 Options.avoid_unnecessary_blocking_io: 0
|
||||||
|
2023/09/26-11:55:44.007255 16 Options.persist_stats_to_disk: 0
|
||||||
|
2023/09/26-11:55:44.007256 16 Options.write_dbid_to_manifest: 0
|
||||||
|
2023/09/26-11:55:44.007258 16 Options.log_readahead_size: 0
|
||||||
|
2023/09/26-11:55:44.007259 16 Options.file_checksum_gen_factory: Unknown
|
||||||
|
2023/09/26-11:55:44.007260 16 Options.best_efforts_recovery: 0
|
||||||
|
2023/09/26-11:55:44.007262 16 Options.max_bgerror_resume_count: 2147483647
|
||||||
|
2023/09/26-11:55:44.007263 16 Options.bgerror_resume_retry_interval: 1000000
|
||||||
|
2023/09/26-11:55:44.007265 16 Options.allow_data_in_errors: 0
|
||||||
|
2023/09/26-11:55:44.007266 16 Options.db_host_id: __hostname__
|
||||||
|
2023/09/26-11:55:44.007267 16 Options.max_background_jobs: 1
|
||||||
|
2023/09/26-11:55:44.007269 16 Options.max_background_compactions: -1
|
||||||
|
2023/09/26-11:55:44.007270 16 Options.max_subcompactions: 1
|
||||||
|
2023/09/26-11:55:44.007272 16 Options.avoid_flush_during_shutdown: 0
|
||||||
|
2023/09/26-11:55:44.007273 16 Options.writable_file_max_buffer_size: 1048576
|
||||||
|
2023/09/26-11:55:44.007274 16 Options.delayed_write_rate : 16777216
|
||||||
|
2023/09/26-11:55:44.007276 16 Options.max_total_wal_size: 0
|
||||||
|
2023/09/26-11:55:44.007277 16 Options.delete_obsolete_files_period_micros: 21600000000
|
||||||
|
2023/09/26-11:55:44.007278 16 Options.stats_dump_period_sec: 600
|
||||||
|
2023/09/26-11:55:44.007280 16 Options.stats_persist_period_sec: 600
|
||||||
|
2023/09/26-11:55:44.007281 16 Options.stats_history_buffer_size: 1048576
|
||||||
|
2023/09/26-11:55:44.007283 16 Options.max_open_files: -1
|
||||||
|
2023/09/26-11:55:44.007284 16 Options.bytes_per_sync: 0
|
||||||
|
2023/09/26-11:55:44.007285 16 Options.wal_bytes_per_sync: 0
|
||||||
|
2023/09/26-11:55:44.007287 16 Options.strict_bytes_per_sync: 0
|
||||||
|
2023/09/26-11:55:44.007288 16 Options.compaction_readahead_size: 0
|
||||||
|
2023/09/26-11:55:44.007290 16 Options.max_background_flushes: 1
|
||||||
|
2023/09/26-11:55:44.007291 16 Compression algorithms supported:
|
||||||
|
2023/09/26-11:55:44.007292 16 kZSTDNotFinalCompression supported: 1
|
||||||
|
2023/09/26-11:55:44.007295 16 kZSTD supported: 1
|
||||||
|
2023/09/26-11:55:44.007296 16 kXpressCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.007298 16 kLZ4HCCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.007299 16 kLZ4Compression supported: 0
|
||||||
|
2023/09/26-11:55:44.007301 16 kBZip2Compression supported: 0
|
||||||
|
2023/09/26-11:55:44.007302 16 kZlibCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.007303 16 kSnappyCompression supported: 0
|
||||||
|
2023/09/26-11:55:44.007306 16 Fast CRC32 supported: Supported on x86
|
||||||
|
2023/09/26-11:55:44.007362 16 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data_meta_kv/MANIFEST-000010
|
||||||
|
2023/09/26-11:55:44.007523 16 [db/column_family.cc:605] --------------- Options for column family [default]:
|
||||||
|
2023/09/26-11:55:44.007526 16 Options.comparator: leveldb.BytewiseComparator
|
||||||
|
2023/09/26-11:55:44.007528 16 Options.merge_operator: None
|
||||||
|
2023/09/26-11:55:44.007529 16 Options.compaction_filter: None
|
||||||
|
2023/09/26-11:55:44.007531 16 Options.compaction_filter_factory: None
|
||||||
|
2023/09/26-11:55:44.007532 16 Options.sst_partitioner_factory: None
|
||||||
|
2023/09/26-11:55:44.007534 16 Options.memtable_factory: SkipListFactory
|
||||||
|
2023/09/26-11:55:44.007536 16 Options.table_factory: BlockBasedTable
|
||||||
|
2023/09/26-11:55:44.007562 16 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9f31e000e0)
|
||||||
|
cache_index_and_filter_blocks: 0
|
||||||
|
cache_index_and_filter_blocks_with_high_priority: 1
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache: 0
|
||||||
|
pin_top_level_index_and_filter: 1
|
||||||
|
index_type: 0
|
||||||
|
data_block_index_type: 0
|
||||||
|
index_shortening: 1
|
||||||
|
data_block_hash_table_util_ratio: 0.750000
|
||||||
|
hash_index_allow_collision: 1
|
||||||
|
checksum: 1
|
||||||
|
no_block_cache: 0
|
||||||
|
block_cache: 0x7f9f31e0a010
|
||||||
|
block_cache_name: LRUCache
|
||||||
|
block_cache_options:
|
||||||
|
capacity : 2502992855
|
||||||
|
num_shard_bits : 6
|
||||||
|
strict_capacity_limit : 0
|
||||||
|
memory_allocator : None
|
||||||
|
high_pri_pool_ratio: 0.500
|
||||||
|
block_cache_compressed: (nil)
|
||||||
|
persistent_cache: (nil)
|
||||||
|
block_size: 65536
|
||||||
|
block_size_deviation: 10
|
||||||
|
block_restart_interval: 16
|
||||||
|
index_block_restart_interval: 1
|
||||||
|
metadata_block_size: 4096
|
||||||
|
partition_filters: 0
|
||||||
|
use_delta_encoding: 1
|
||||||
|
filter_policy: nullptr
|
||||||
|
whole_key_filtering: 1
|
||||||
|
verify_compression: 0
|
||||||
|
read_amp_bytes_per_bit: 0
|
||||||
|
format_version: 5
|
||||||
|
enable_index_compression: 1
|
||||||
|
block_align: 0
|
||||||
|
max_auto_readahead_size: 262144
|
||||||
|
prepopulate_block_cache: 0
|
||||||
|
2023/09/26-11:55:44.007566 16 Options.write_buffer_size: 67108864
|
||||||
|
2023/09/26-11:55:44.007568 16 Options.max_write_buffer_number: 2
|
||||||
|
2023/09/26-11:55:44.007569 16 Options.compression[0]: NoCompression
|
||||||
|
2023/09/26-11:55:44.007571 16 Options.compression[1]: ZSTD
|
||||||
|
2023/09/26-11:55:44.007572 16 Options.compression[2]: ZSTD
|
||||||
|
2023/09/26-11:55:44.007574 16 Options.bottommost_compression: Disabled
|
||||||
|
2023/09/26-11:55:44.007575 16 Options.prefix_extractor: nullptr
|
||||||
|
2023/09/26-11:55:44.007577 16 Options.memtable_insert_with_hint_prefix_extractor: nullptr
|
||||||
|
2023/09/26-11:55:44.007578 16 Options.num_levels: 3
|
||||||
|
2023/09/26-11:55:44.007580 16 Options.min_write_buffer_number_to_merge: 1
|
||||||
|
2023/09/26-11:55:44.007581 16 Options.max_write_buffer_number_to_maintain: 0
|
||||||
|
2023/09/26-11:55:44.007583 16 Options.max_write_buffer_size_to_maintain: 0
|
||||||
|
2023/09/26-11:55:44.007584 16 Options.bottommost_compression_opts.window_bits: -14
|
||||||
|
2023/09/26-11:55:44.007585 16 Options.bottommost_compression_opts.level: 32767
|
||||||
|
2023/09/26-11:55:44.007587 16 Options.bottommost_compression_opts.strategy: 0
|
||||||
|
2023/09/26-11:55:44.007588 16 Options.bottommost_compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-11:55:44.007590 16 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-11:55:44.007591 16 Options.bottommost_compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-11:55:44.007592 16 Options.bottommost_compression_opts.enabled: false
|
||||||
|
2023/09/26-11:55:44.007594 16 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-11:55:44.007595 16 Options.compression_opts.window_bits: -14
|
||||||
|
2023/09/26-11:55:44.007597 16 Options.compression_opts.level: 32767
|
||||||
|
2023/09/26-11:55:44.007598 16 Options.compression_opts.strategy: 0
|
||||||
|
2023/09/26-11:55:44.007600 16 Options.compression_opts.max_dict_bytes: 0
|
||||||
|
2023/09/26-11:55:44.007601 16 Options.compression_opts.zstd_max_train_bytes: 0
|
||||||
|
2023/09/26-11:55:44.007602 16 Options.compression_opts.parallel_threads: 1
|
||||||
|
2023/09/26-11:55:44.007604 16 Options.compression_opts.enabled: false
|
||||||
|
2023/09/26-11:55:44.007610 16 Options.compression_opts.max_dict_buffer_bytes: 0
|
||||||
|
2023/09/26-11:55:44.007612 16 Options.level0_file_num_compaction_trigger: 4
|
||||||
|
2023/09/26-11:55:44.007613 16 Options.level0_slowdown_writes_trigger: 20
|
||||||
|
2023/09/26-11:55:44.007615 16 Options.level0_stop_writes_trigger: 36
|
||||||
|
2023/09/26-11:55:44.007616 16 Options.target_file_size_base: 67108864
|
||||||
|
2023/09/26-11:55:44.007617 16 Options.target_file_size_multiplier: 2
|
||||||
|
2023/09/26-11:55:44.007619 16 Options.max_bytes_for_level_base: 268435456
|
||||||
|
2023/09/26-11:55:44.007620 16 Options.level_compaction_dynamic_level_bytes: 0
|
||||||
|
2023/09/26-11:55:44.007622 16 Options.max_bytes_for_level_multiplier: 10.000000
|
||||||
|
2023/09/26-11:55:44.007624 16 Options.max_bytes_for_level_multiplier_addtl[0]: 1
|
||||||
|
2023/09/26-11:55:44.007626 16 Options.max_bytes_for_level_multiplier_addtl[1]: 1
|
||||||
|
2023/09/26-11:55:44.007627 16 Options.max_bytes_for_level_multiplier_addtl[2]: 1
|
||||||
|
2023/09/26-11:55:44.007629 16 Options.max_bytes_for_level_multiplier_addtl[3]: 1
|
||||||
|
2023/09/26-11:55:44.007630 16 Options.max_bytes_for_level_multiplier_addtl[4]: 1
|
||||||
|
2023/09/26-11:55:44.007632 16 Options.max_bytes_for_level_multiplier_addtl[5]: 1
|
||||||
|
2023/09/26-11:55:44.007633 16 Options.max_bytes_for_level_multiplier_addtl[6]: 1
|
||||||
|
2023/09/26-11:55:44.007635 16 Options.max_sequential_skip_in_iterations: 8
|
||||||
|
2023/09/26-11:55:44.007636 16 Options.max_compaction_bytes: 1677721600
|
||||||
|
2023/09/26-11:55:44.007637 16 Options.arena_block_size: 1048576
|
||||||
|
2023/09/26-11:55:44.007639 16 Options.soft_pending_compaction_bytes_limit: 68719476736
|
||||||
|
2023/09/26-11:55:44.007640 16 Options.hard_pending_compaction_bytes_limit: 274877906944
|
||||||
|
2023/09/26-11:55:44.007642 16 Options.rate_limit_delay_max_milliseconds: 100
|
||||||
|
2023/09/26-11:55:44.007643 16 Options.disable_auto_compactions: 0
|
||||||
|
2023/09/26-11:55:44.007645 16 Options.compaction_style: kCompactionStyleLevel
|
||||||
|
2023/09/26-11:55:44.007647 16 Options.compaction_pri: kMinOverlappingRatio
|
||||||
|
2023/09/26-11:55:44.007649 16 Options.compaction_options_universal.size_ratio: 1
|
||||||
|
2023/09/26-11:55:44.007650 16 Options.compaction_options_universal.min_merge_width: 2
|
||||||
|
2023/09/26-11:55:44.007652 16 Options.compaction_options_universal.max_merge_width: 4294967295
|
||||||
|
2023/09/26-11:55:44.007653 16 Options.compaction_options_universal.max_size_amplification_percent: 200
|
||||||
|
2023/09/26-11:55:44.007654 16 Options.compaction_options_universal.compression_size_percent: -1
|
||||||
|
2023/09/26-11:55:44.007656 16 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
|
||||||
|
2023/09/26-11:55:44.007657 16 Options.compaction_options_fifo.max_table_files_size: 1073741824
|
||||||
|
2023/09/26-11:55:44.007659 16 Options.compaction_options_fifo.allow_compaction: 0
|
||||||
|
2023/09/26-11:55:44.007662 16 Options.table_properties_collectors:
|
||||||
|
2023/09/26-11:55:44.007664 16 Options.inplace_update_support: 0
|
||||||
|
2023/09/26-11:55:44.007665 16 Options.inplace_update_num_locks: 10000
|
||||||
|
2023/09/26-11:55:44.007666 16 Options.memtable_prefix_bloom_size_ratio: 0.000000
|
||||||
|
2023/09/26-11:55:44.007668 16 Options.memtable_whole_key_filtering: 0
|
||||||
|
2023/09/26-11:55:44.007670 16 Options.memtable_huge_page_size: 0
|
||||||
|
2023/09/26-11:55:44.007671 16 Options.bloom_locality: 0
|
||||||
|
2023/09/26-11:55:44.007672 16 Options.max_successive_merges: 0
|
||||||
|
2023/09/26-11:55:44.007674 16 Options.optimize_filters_for_hits: 0
|
||||||
|
2023/09/26-11:55:44.007675 16 Options.paranoid_file_checks: 0
|
||||||
|
2023/09/26-11:55:44.007677 16 Options.force_consistency_checks: 1
|
||||||
|
2023/09/26-11:55:44.007678 16 Options.report_bg_io_stats: 0
|
||||||
|
2023/09/26-11:55:44.007679 16 Options.ttl: 2592000
|
||||||
|
2023/09/26-11:55:44.007681 16 Options.periodic_compaction_seconds: 0
|
||||||
|
2023/09/26-11:55:44.007682 16 Options.enable_blob_files: false
|
||||||
|
2023/09/26-11:55:44.007687 16 Options.min_blob_size: 0
|
||||||
|
2023/09/26-11:55:44.007687 16 Options.blob_file_size: 268435456
|
||||||
|
2023/09/26-11:55:44.007688 16 Options.blob_compression_type: NoCompression
|
||||||
|
2023/09/26-11:55:44.007689 16 Options.enable_blob_garbage_collection: false
|
||||||
|
2023/09/26-11:55:44.007691 16 Options.blob_garbage_collection_age_cutoff: 0.250000
|
||||||
|
2023/09/26-11:55:44.007693 16 Options.blob_garbage_collection_force_threshold: 1.000000
|
||||||
|
2023/09/26-11:55:44.007694 16 Options.blob_compaction_readahead_size: 0
|
||||||
|
2023/09/26-11:55:44.008806 16 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data_meta_kv/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 161, log_number is 6,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
|
||||||
|
2023/09/26-11:55:44.008811 16 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 6
|
||||||
|
2023/09/26-11:55:44.008866 16 [db/version_set.cc:4384] Creating manifest 14
|
||||||
|
2023/09/26-11:55:44.013008 16 EVENT_LOG_v1 {"time_micros": 1695729344013000, "job": 1, "event": "recovery_started", "wal_files": [11]}
|
||||||
|
2023/09/26-11:55:44.013012 16 [db/db_impl/db_impl_open.cc:883] Recovering log #11 mode 2
|
||||||
|
2023/09/26-11:55:44.072119 16 EVENT_LOG_v1 {"time_micros": 1695729344072083, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 15, "file_size": 1217, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 249, "index_size": 51, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 285, "raw_average_key_size": 40, "raw_value_size": 51, "raw_average_value_size": 7, "num_data_blocks": 1, "num_entries": 7, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695729344, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf0fe53a-7182-458f-baa9-e07d3ffe5860", "db_session_id": "LDJPBRCKW95VBBDOA0BC", "orig_file_number": 15}}
|
||||||
|
2023/09/26-11:55:44.072163 16 [db/version_set.cc:4384] Creating manifest 16
|
||||||
|
2023/09/26-11:55:44.076244 16 EVENT_LOG_v1 {"time_micros": 1695729344076241, "job": 1, "event": "recovery_finished"}
|
||||||
|
2023/09/26-11:55:44.080851 16 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data_meta_kv/000011.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
|
||||||
|
2023/09/26-11:55:44.080869 16 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9f31e55000
|
||||||
|
2023/09/26-11:55:44.080900 16 DB pointer 0x7f9f31e39000
|
||||||
|
2023/09/26-11:55:44.081157 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-11:55:44.081167 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 0.1 total, 0.1 interval
|
||||||
|
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 0.1 total, 0.1 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 1 last_copies: 0 last_secs: 3.6e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:05:44.081406 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:05:44.081455 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 600.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 6953 writes, 6953 keys, 6953 commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 6953 writes, 0 syncs, 6953.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 6953 writes, 6953 keys, 6953 commit groups, 1.0 writes per commit group, ingest: 0.39 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 6953 writes, 0 syncs, 6953.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 600.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 2 last_copies: 0 last_secs: 4.8e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:15:44.081714 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:15:44.081747 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1200.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 14K writes, 0 syncs, 14077.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7124 writes, 7124 keys, 7124 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1200.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 3 last_copies: 0 last_secs: 5.7e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:25:44.081938 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:25:44.081971 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 1800.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 21K writes, 0 syncs, 21187.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7110 writes, 7110 keys, 7110 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7110 writes, 0 syncs, 7110.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 1800.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 4 last_copies: 0 last_secs: 4e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:35:44.082170 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:35:44.082210 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 2400.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 28K writes, 28K keys, 28K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 28K writes, 0 syncs, 28311.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7124 writes, 7124 keys, 7124 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 2400.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 5 last_copies: 0 last_secs: 4.2e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:45:44.082582 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:45:44.082653 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3000.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 35K writes, 35K keys, 35K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 35K writes, 0 syncs, 35425.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7114 writes, 7114 keys, 7114 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7114 writes, 0 syncs, 7114.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3000.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 6 last_copies: 0 last_secs: 9.4e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
||||||
|
2023/09/26-12:55:44.083022 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
|
||||||
|
2023/09/26-12:55:44.083094 36 [db/db_impl/db_impl.cc:1006]
|
||||||
|
** DB Stats **
|
||||||
|
Uptime(secs): 3600.1 total, 600.0 interval
|
||||||
|
Cumulative writes: 42K writes, 42K keys, 42K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative WAL: 42K writes, 0 syncs, 42513.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
Interval writes: 7088 writes, 7088 keys, 7085 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
|
||||||
|
Interval WAL: 7088 writes, 0 syncs, 7088.00 writes per sync, written: 0.00 GB, 0.00 MB/s
|
||||||
|
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
|
||||||
|
|
||||||
|
** Compaction Stats [default] **
|
||||||
|
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
|
||||||
|
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
||||||
|
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
|
||||||
|
|
||||||
|
Blob file count: 0, total size: 0.0 GB
|
||||||
|
|
||||||
|
Uptime(secs): 3600.1 total, 600.0 interval
|
||||||
|
Flush(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(GB): cumulative 0.000, interval 0.000
|
||||||
|
AddFile(Total Files): cumulative 0, interval 0
|
||||||
|
AddFile(L0 Files): cumulative 0, interval 0
|
||||||
|
AddFile(Keys): cumulative 0, interval 0
|
||||||
|
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
|
||||||
|
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
|
||||||
|
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 7 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
|
||||||
|
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
|
||||||
|
|
||||||
|
** File Read Latency Histogram By Level [default] **
|
|
@ -0,0 +1,190 @@
|
||||||
|
# This is a RocksDB option file.
|
||||||
|
#
|
||||||
|
# For detailed file format spec, please refer to the example file
|
||||||
|
# in examples/rocksdb_option_file_example.ini
|
||||||
|
#
|
||||||
|
|
||||||
|
[Version]
|
||||||
|
rocksdb_version=6.27.3
|
||||||
|
options_file_version=1.1
|
||||||
|
|
||||||
|
[DBOptions]
|
||||||
|
max_open_files=-1
|
||||||
|
stats_history_buffer_size=1048576
|
||||||
|
stats_persist_period_sec=600
|
||||||
|
max_background_flushes=1
|
||||||
|
stats_dump_period_sec=600
|
||||||
|
compaction_readahead_size=0
|
||||||
|
bytes_per_sync=0
|
||||||
|
delete_obsolete_files_period_micros=21600000000
|
||||||
|
max_total_wal_size=0
|
||||||
|
delayed_write_rate=16777216
|
||||||
|
wal_bytes_per_sync=0
|
||||||
|
writable_file_max_buffer_size=1048576
|
||||||
|
avoid_flush_during_shutdown=false
|
||||||
|
max_subcompactions=1
|
||||||
|
strict_bytes_per_sync=false
|
||||||
|
max_background_compactions=-1
|
||||||
|
base_background_compactions=-1
|
||||||
|
max_background_jobs=1
|
||||||
|
file_checksum_gen_factory=nullptr
|
||||||
|
db_host_id=__hostname__
|
||||||
|
bgerror_resume_retry_interval=1000000
|
||||||
|
best_efforts_recovery=false
|
||||||
|
avoid_unnecessary_blocking_io=false
|
||||||
|
two_write_queues=false
|
||||||
|
atomic_flush=false
|
||||||
|
preserve_deletes=false
|
||||||
|
allow_ingest_behind=false
|
||||||
|
lowest_used_cache_tier=kNonVolatileBlockTier
|
||||||
|
avoid_flush_during_recovery=false
|
||||||
|
info_log_level=INFO_LEVEL
|
||||||
|
access_hint_on_compaction_start=NORMAL
|
||||||
|
max_bgerror_resume_count=2147483647
|
||||||
|
write_thread_slow_yield_usec=3
|
||||||
|
allow_concurrent_memtable_write=true
|
||||||
|
WAL_ttl_seconds=0
|
||||||
|
manual_wal_flush=false
|
||||||
|
dump_malloc_stats=false
|
||||||
|
wal_recovery_mode=kPointInTimeRecovery
|
||||||
|
log_file_time_to_roll=0
|
||||||
|
enable_write_thread_adaptive_yield=true
|
||||||
|
recycle_log_file_num=0
|
||||||
|
table_cache_numshardbits=6
|
||||||
|
max_file_opening_threads=16
|
||||||
|
allow_data_in_errors=false
|
||||||
|
use_fsync=false
|
||||||
|
unordered_write=false
|
||||||
|
fail_if_options_file_error=false
|
||||||
|
random_access_max_buffer_size=1048576
|
||||||
|
new_table_reader_for_compaction_inputs=false
|
||||||
|
skip_checking_sst_file_sizes_on_db_open=false
|
||||||
|
skip_stats_update_on_db_open=false
|
||||||
|
persist_stats_to_disk=false
|
||||||
|
track_and_verify_wals_in_manifest=false
|
||||||
|
enable_pipelined_write=false
|
||||||
|
flush_verify_memtable_count=true
|
||||||
|
log_readahead_size=0
|
||||||
|
is_fd_close_on_exec=true
|
||||||
|
WAL_size_limit_MB=0
|
||||||
|
experimental_mempurge_threshold=0.000000
|
||||||
|
write_dbid_to_manifest=false
|
||||||
|
use_adaptive_mutex=false
|
||||||
|
error_if_exists=false
|
||||||
|
write_thread_max_yield_usec=100
|
||||||
|
enable_thread_tracking=false
|
||||||
|
db_write_buffer_size=0
|
||||||
|
create_missing_column_families=false
|
||||||
|
paranoid_checks=true
|
||||||
|
create_if_missing=true
|
||||||
|
wal_filter=nullptr
|
||||||
|
max_manifest_file_size=1073741824
|
||||||
|
allow_2pc=false
|
||||||
|
use_direct_io_for_flush_and_compaction=false
|
||||||
|
manifest_preallocation_size=4194304
|
||||||
|
use_direct_reads=false
|
||||||
|
allow_fallocate=true
|
||||||
|
max_write_batch_group_size_bytes=1048576
|
||||||
|
keep_log_file_num=1000
|
||||||
|
allow_mmap_reads=false
|
||||||
|
max_log_file_size=0
|
||||||
|
allow_mmap_writes=false
|
||||||
|
advise_random_on_open=true
|
||||||
|
|
||||||
|
|
||||||
|
[CFOptions "default"]
|
||||||
|
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
bottommost_compression=kDisableCompressionOption
|
||||||
|
enable_blob_garbage_collection=false
|
||||||
|
blob_file_size=268435456
|
||||||
|
sample_for_compression=0
|
||||||
|
periodic_compaction_seconds=0
|
||||||
|
ttl=2592000
|
||||||
|
blob_garbage_collection_age_cutoff=0.250000
|
||||||
|
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
|
||||||
|
compression=kNoCompression
|
||||||
|
max_sequential_skip_in_iterations=8
|
||||||
|
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
|
||||||
|
max_bytes_for_level_multiplier=10.000000
|
||||||
|
max_bytes_for_level_base=268435456
|
||||||
|
memtable_whole_key_filtering=false
|
||||||
|
max_successive_merges=0
|
||||||
|
blob_compaction_readahead_size=0
|
||||||
|
inplace_update_num_locks=10000
|
||||||
|
arena_block_size=1048576
|
||||||
|
target_file_size_multiplier=2
|
||||||
|
prefix_extractor=nullptr
|
||||||
|
max_write_buffer_number=2
|
||||||
|
blob_compression_type=kNoCompression
|
||||||
|
level0_stop_writes_trigger=36
|
||||||
|
level0_slowdown_writes_trigger=20
|
||||||
|
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
|
||||||
|
level0_file_num_compaction_trigger=4
|
||||||
|
write_buffer_size=67108864
|
||||||
|
memtable_huge_page_size=0
|
||||||
|
max_compaction_bytes=1677721600
|
||||||
|
min_blob_size=0
|
||||||
|
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
hard_pending_compaction_bytes_limit=274877906944
|
||||||
|
target_file_size_base=67108864
|
||||||
|
soft_pending_compaction_bytes_limit=68719476736
|
||||||
|
enable_blob_files=false
|
||||||
|
paranoid_file_checks=false
|
||||||
|
check_flush_compaction_key_order=true
|
||||||
|
blob_garbage_collection_force_threshold=1.000000
|
||||||
|
disable_auto_compactions=false
|
||||||
|
memtable_prefix_bloom_size_ratio=0.000000
|
||||||
|
report_bg_io_stats=false
|
||||||
|
compaction_pri=kMinOverlappingRatio
|
||||||
|
compaction_filter_factory=nullptr
|
||||||
|
comparator=leveldb.BytewiseComparator
|
||||||
|
sst_partitioner_factory=nullptr
|
||||||
|
bloom_locality=0
|
||||||
|
compaction_style=kCompactionStyleLevel
|
||||||
|
min_write_buffer_number_to_merge=1
|
||||||
|
max_write_buffer_size_to_maintain=0
|
||||||
|
max_write_buffer_number_to_maintain=0
|
||||||
|
merge_operator=nullptr
|
||||||
|
memtable_factory=SkipListFactory
|
||||||
|
memtable_insert_with_hint_prefix_extractor=nullptr
|
||||||
|
compression_per_level=kNoCompression:kZSTD:kZSTD
|
||||||
|
num_levels=3
|
||||||
|
force_consistency_checks=true
|
||||||
|
optimize_filters_for_hits=false
|
||||||
|
compaction_filter=nullptr
|
||||||
|
level_compaction_dynamic_level_bytes=false
|
||||||
|
inplace_update_support=false
|
||||||
|
table_factory=BlockBasedTable
|
||||||
|
|
||||||
|
[TableOptions/BlockBasedTable "default"]
|
||||||
|
pin_top_level_index_and_filter=true
|
||||||
|
block_align=false
|
||||||
|
read_amp_bytes_per_bit=0
|
||||||
|
verify_compression=false
|
||||||
|
enable_index_compression=true
|
||||||
|
reserve_table_builder_memory=false
|
||||||
|
whole_key_filtering=true
|
||||||
|
max_auto_readahead_size=262144
|
||||||
|
optimize_filters_for_memory=false
|
||||||
|
index_block_restart_interval=1
|
||||||
|
prepopulate_block_cache=kDisable
|
||||||
|
block_restart_interval=16
|
||||||
|
block_size=65536
|
||||||
|
format_version=5
|
||||||
|
partition_filters=false
|
||||||
|
block_size_deviation=10
|
||||||
|
no_block_cache=false
|
||||||
|
checksum=kCRC32c
|
||||||
|
data_block_hash_table_util_ratio=0.750000
|
||||||
|
index_shortening=kShortenSeparators
|
||||||
|
data_block_index_type=kDataBlockBinarySearch
|
||||||
|
hash_index_allow_collision=true
|
||||||
|
filter_policy=nullptr
|
||||||
|
metadata_block_size=4096
|
||||||
|
index_type=kBinarySearch
|
||||||
|
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache=false
|
||||||
|
cache_index_and_filter_blocks_with_high_priority=true
|
||||||
|
cache_index_and_filter_blocks=false
|
||||||
|
flush_block_policy_factory=FlushBlockBySizePolicyFactory
|
||||||
|
|
|
@ -0,0 +1,190 @@
|
||||||
|
# This is a RocksDB option file.
|
||||||
|
#
|
||||||
|
# For detailed file format spec, please refer to the example file
|
||||||
|
# in examples/rocksdb_option_file_example.ini
|
||||||
|
#
|
||||||
|
|
||||||
|
[Version]
|
||||||
|
rocksdb_version=6.27.3
|
||||||
|
options_file_version=1.1
|
||||||
|
|
||||||
|
[DBOptions]
|
||||||
|
max_open_files=-1
|
||||||
|
stats_history_buffer_size=1048576
|
||||||
|
stats_persist_period_sec=600
|
||||||
|
max_background_flushes=1
|
||||||
|
stats_dump_period_sec=600
|
||||||
|
compaction_readahead_size=0
|
||||||
|
bytes_per_sync=0
|
||||||
|
delete_obsolete_files_period_micros=21600000000
|
||||||
|
max_total_wal_size=0
|
||||||
|
delayed_write_rate=16777216
|
||||||
|
wal_bytes_per_sync=0
|
||||||
|
writable_file_max_buffer_size=1048576
|
||||||
|
avoid_flush_during_shutdown=false
|
||||||
|
max_subcompactions=1
|
||||||
|
strict_bytes_per_sync=false
|
||||||
|
max_background_compactions=-1
|
||||||
|
base_background_compactions=-1
|
||||||
|
max_background_jobs=1
|
||||||
|
file_checksum_gen_factory=nullptr
|
||||||
|
db_host_id=__hostname__
|
||||||
|
bgerror_resume_retry_interval=1000000
|
||||||
|
best_efforts_recovery=false
|
||||||
|
avoid_unnecessary_blocking_io=false
|
||||||
|
two_write_queues=false
|
||||||
|
atomic_flush=false
|
||||||
|
preserve_deletes=false
|
||||||
|
allow_ingest_behind=false
|
||||||
|
lowest_used_cache_tier=kNonVolatileBlockTier
|
||||||
|
avoid_flush_during_recovery=false
|
||||||
|
info_log_level=INFO_LEVEL
|
||||||
|
access_hint_on_compaction_start=NORMAL
|
||||||
|
max_bgerror_resume_count=2147483647
|
||||||
|
write_thread_slow_yield_usec=3
|
||||||
|
allow_concurrent_memtable_write=true
|
||||||
|
WAL_ttl_seconds=0
|
||||||
|
manual_wal_flush=false
|
||||||
|
dump_malloc_stats=false
|
||||||
|
wal_recovery_mode=kPointInTimeRecovery
|
||||||
|
log_file_time_to_roll=0
|
||||||
|
enable_write_thread_adaptive_yield=true
|
||||||
|
recycle_log_file_num=0
|
||||||
|
table_cache_numshardbits=6
|
||||||
|
max_file_opening_threads=16
|
||||||
|
allow_data_in_errors=false
|
||||||
|
use_fsync=false
|
||||||
|
unordered_write=false
|
||||||
|
fail_if_options_file_error=false
|
||||||
|
random_access_max_buffer_size=1048576
|
||||||
|
new_table_reader_for_compaction_inputs=false
|
||||||
|
skip_checking_sst_file_sizes_on_db_open=false
|
||||||
|
skip_stats_update_on_db_open=false
|
||||||
|
persist_stats_to_disk=false
|
||||||
|
track_and_verify_wals_in_manifest=false
|
||||||
|
enable_pipelined_write=false
|
||||||
|
flush_verify_memtable_count=true
|
||||||
|
log_readahead_size=0
|
||||||
|
is_fd_close_on_exec=true
|
||||||
|
WAL_size_limit_MB=0
|
||||||
|
experimental_mempurge_threshold=0.000000
|
||||||
|
write_dbid_to_manifest=false
|
||||||
|
use_adaptive_mutex=false
|
||||||
|
error_if_exists=false
|
||||||
|
write_thread_max_yield_usec=100
|
||||||
|
enable_thread_tracking=false
|
||||||
|
db_write_buffer_size=0
|
||||||
|
create_missing_column_families=false
|
||||||
|
paranoid_checks=true
|
||||||
|
create_if_missing=true
|
||||||
|
wal_filter=nullptr
|
||||||
|
max_manifest_file_size=1073741824
|
||||||
|
allow_2pc=false
|
||||||
|
use_direct_io_for_flush_and_compaction=false
|
||||||
|
manifest_preallocation_size=4194304
|
||||||
|
use_direct_reads=false
|
||||||
|
allow_fallocate=true
|
||||||
|
max_write_batch_group_size_bytes=1048576
|
||||||
|
keep_log_file_num=1000
|
||||||
|
allow_mmap_reads=false
|
||||||
|
max_log_file_size=0
|
||||||
|
allow_mmap_writes=false
|
||||||
|
advise_random_on_open=true
|
||||||
|
|
||||||
|
|
||||||
|
[CFOptions "default"]
|
||||||
|
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
bottommost_compression=kDisableCompressionOption
|
||||||
|
enable_blob_garbage_collection=false
|
||||||
|
blob_file_size=268435456
|
||||||
|
sample_for_compression=0
|
||||||
|
periodic_compaction_seconds=0
|
||||||
|
ttl=2592000
|
||||||
|
blob_garbage_collection_age_cutoff=0.250000
|
||||||
|
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
|
||||||
|
compression=kNoCompression
|
||||||
|
max_sequential_skip_in_iterations=8
|
||||||
|
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
|
||||||
|
max_bytes_for_level_multiplier=10.000000
|
||||||
|
max_bytes_for_level_base=268435456
|
||||||
|
memtable_whole_key_filtering=false
|
||||||
|
max_successive_merges=0
|
||||||
|
blob_compaction_readahead_size=0
|
||||||
|
inplace_update_num_locks=10000
|
||||||
|
arena_block_size=1048576
|
||||||
|
target_file_size_multiplier=2
|
||||||
|
prefix_extractor=nullptr
|
||||||
|
max_write_buffer_number=2
|
||||||
|
blob_compression_type=kNoCompression
|
||||||
|
level0_stop_writes_trigger=36
|
||||||
|
level0_slowdown_writes_trigger=20
|
||||||
|
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
|
||||||
|
level0_file_num_compaction_trigger=4
|
||||||
|
write_buffer_size=67108864
|
||||||
|
memtable_huge_page_size=0
|
||||||
|
max_compaction_bytes=1677721600
|
||||||
|
min_blob_size=0
|
||||||
|
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
|
||||||
|
hard_pending_compaction_bytes_limit=274877906944
|
||||||
|
target_file_size_base=67108864
|
||||||
|
soft_pending_compaction_bytes_limit=68719476736
|
||||||
|
enable_blob_files=false
|
||||||
|
paranoid_file_checks=false
|
||||||
|
check_flush_compaction_key_order=true
|
||||||
|
blob_garbage_collection_force_threshold=1.000000
|
||||||
|
disable_auto_compactions=false
|
||||||
|
memtable_prefix_bloom_size_ratio=0.000000
|
||||||
|
report_bg_io_stats=false
|
||||||
|
compaction_pri=kMinOverlappingRatio
|
||||||
|
compaction_filter_factory=nullptr
|
||||||
|
comparator=leveldb.BytewiseComparator
|
||||||
|
sst_partitioner_factory=nullptr
|
||||||
|
bloom_locality=0
|
||||||
|
compaction_style=kCompactionStyleLevel
|
||||||
|
min_write_buffer_number_to_merge=1
|
||||||
|
max_write_buffer_size_to_maintain=0
|
||||||
|
max_write_buffer_number_to_maintain=0
|
||||||
|
merge_operator=nullptr
|
||||||
|
memtable_factory=SkipListFactory
|
||||||
|
memtable_insert_with_hint_prefix_extractor=nullptr
|
||||||
|
compression_per_level=kNoCompression:kZSTD:kZSTD
|
||||||
|
num_levels=3
|
||||||
|
force_consistency_checks=true
|
||||||
|
optimize_filters_for_hits=false
|
||||||
|
compaction_filter=nullptr
|
||||||
|
level_compaction_dynamic_level_bytes=false
|
||||||
|
inplace_update_support=false
|
||||||
|
table_factory=BlockBasedTable
|
||||||
|
|
||||||
|
[TableOptions/BlockBasedTable "default"]
|
||||||
|
pin_top_level_index_and_filter=true
|
||||||
|
block_align=false
|
||||||
|
read_amp_bytes_per_bit=0
|
||||||
|
verify_compression=false
|
||||||
|
enable_index_compression=true
|
||||||
|
reserve_table_builder_memory=false
|
||||||
|
whole_key_filtering=true
|
||||||
|
max_auto_readahead_size=262144
|
||||||
|
optimize_filters_for_memory=false
|
||||||
|
index_block_restart_interval=1
|
||||||
|
prepopulate_block_cache=kDisable
|
||||||
|
block_restart_interval=16
|
||||||
|
block_size=65536
|
||||||
|
format_version=5
|
||||||
|
partition_filters=false
|
||||||
|
block_size_deviation=10
|
||||||
|
no_block_cache=false
|
||||||
|
checksum=kCRC32c
|
||||||
|
data_block_hash_table_util_ratio=0.750000
|
||||||
|
index_shortening=kShortenSeparators
|
||||||
|
data_block_index_type=kDataBlockBinarySearch
|
||||||
|
hash_index_allow_collision=true
|
||||||
|
filter_policy=nullptr
|
||||||
|
metadata_block_size=4096
|
||||||
|
index_type=kBinarySearch
|
||||||
|
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
|
||||||
|
pin_l0_filter_and_index_blocks_in_cache=false
|
||||||
|
cache_index_and_filter_blocks_with_high_priority=true
|
||||||
|
cache_index_and_filter_blocks=false
|
||||||
|
flush_block_policy_factory=FlushBlockBySizePolicyFactory
|
||||||
|
|
|
@ -0,0 +1 @@
|
||||||
|
{"version":"1","format":"xl-single","id":"939dc802-c818-45a8-8ff0-9ed126411381","xl":{"version":"3","this":"92610d0c-4c3f-44d6-afb0-9a46848acc39","sets":[["92610d0c-4c3f-44d6-afb0-9a46848acc39"]],"distributionAlgo":"SIPMOD+PARITY"}}
|