init commit

main
vaa_andrey 2023-09-27 10:13:34 +06:00
commit c96837ca4a
118 changed files with 43881 additions and 0 deletions

227
README.md Normal file
View File

@ -0,0 +1,227 @@
# Reverse Image Search Based on Milvus & Towhee
This demo uses [towhee](https://github.com/towhee-io/towhee) image embedding operator to extract image features by ResNet50, and uses Milvus to build a system that can perform reverse image search.
The system architecture is as below:
<img src="pic/workflow.png" height = "500" alt="arch" align=center />
## Data Source
This demo uses the PASCAL VOC image set, which contains 17125 images with 20 categories: human; animals (birds, cats, cows, dogs, horses, sheep); transportation (planes, bikes, boats, buses, cars, motorcycles, trains); household (bottles, chairs, tables, pot plants, sofas, TVs).
Dataset size: ~ 2 GB.
Download location: https://drive.google.com/file/d/1n_370-5Stk4t0uDV1QqvYkcvyV8rbw0O/view?usp=sharing
> Note: You can also use other images for testing. This system supports the following formats: .jpg and .png.
## Local Deployment
### Requirements
- [Milvus 2.2.10](https://milvus.io/)
- [Towhee](https://towhee.io/)
- [MySQL](https://hub.docker.com/r/mysql/mysql-server)
- [Python3](https://www.python.org/downloads/)
- [Docker](https://docs.docker.com/engine/install/)
- [Docker Compose](https://docs.docker.com/compose/install/)
## Option 1: Deploy with Docker Compose
The reverse image search system requires Milvus, MySQL, WebServer and WebClient services. We can start these containers with one click through [docker-compose.yaml](./docker-compose.yaml).
- Modify docker-compose.yaml to map your data directory to the docker container of WebServer
```bash
$ wget https://raw.githubusercontent.com/milvus-io/bootcamp/master/solutions/image/reverse_image_search/docker-compose.yaml
$ vim docker-compose.yaml
```
**Then to change line 75:** `./data:/data` --> `your_data_path:/data`
- Create containers & start servers with docker-compose.yaml
```bash
$ docker-compose up -d
```
Then you will see the that all containers are created.
```bash
Creating network "quick_deploy_app_net" with driver "bridge"
Creating milvus-etcd ... done
Creating milvus-minio ... done
Creating img-search-mysql ... done
Creating img-search-webclient ... done
Creating milvus-standalone ... done
Creating img-search-webserver ... done
```
And show all containers with `docker ps`, and you can use `docker logs img-search-webserver` to get the logs of **server** container.
```bash
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
f24ddb15a529 milvusbootcamp/img-search-server:2.2.10 "/bin/sh -c 'python3…" 35 minutes ago Up 34 minutes 0.0.0.0:5000->5000/tcp, :::5000->5000/tcp img-search-webserver
d26b5cf21822 milvusdb/milvus:v2.2.10 "/tini -- milvus run…" 35 minutes ago Up 35 minutes 0.0.0.0:9091->9091/tcp, :::9091->9091/tcp, 0.0.0.0:19530->19530/tcp, :::19530->19530/tcp milvus-standalone
1e9254f56006 minio/minio:RELEASE.2023-03-20T20-16-18Z "/usr/bin/docker-ent…" 35 minutes ago Up 35 minutes (healthy) 9000/tcp milvus-minio
445cef3fe474 milvusbootcamp/img-search-client:2.2.10 "/docker-entrypoint.…" 35 minutes ago Up 35 minutes (unhealthy) 0.0.0.0:8001->80/tcp, :::8001->80/tcp img-search-webclient
d9bbab39f325 mysql:5.7 "docker-entrypoint.s…" 35 minutes ago Up 35 minutes 33060/tcp, 0.0.0.0:3306->3306/tcp, :::3306->3306/tcp img-search-mysql
807c2ace0b28 quay.io/coreos/etcd:v3.5.5 "etcd -advertise-cli…" 35 minutes ago Up 35 minutes 2379-2380/tcp milvus-etcd
```
## Option 2: Deploy with source code
We recommend using Docker Compose to deploy the reverse image search system. However, you also can run from source code, you need to manually start [Milvus](https://milvus.io) and [Mysql](https://dev.mysql.com/doc/mysql-installation-excerpt/5.7/en/docker-mysql-getting-started.html). Next show you how to run the API server and Client.
### 1. Start Milvus & Mysql
First, you need to start Milvus & Mysql servers.
Refer [Milvus Standalone](https://milvus.io/docs/install_standalone-docker.md) for how to install Milvus.
```bash
$ wget https://github.com/milvus-io/milvus/releases/download/v2.2.10/milvus-standalone-docker-compose.yml -O docker-compose.yml
$ sudo docker-compose up -d
```
There are several ways to start Mysql. One option is using docker to create a container:
```bash
$ docker run -p 3306:3306 -e MYSQL_ROOT_PASSWORD=123456 -d --name image_search_mysql mysql:5.7
```
### 2. Start API Server
Then to start the system server, and it provides HTTP backend services.
- **Install the Python packages**
> Please note the Milvus version should [match pymilvus](https://milvus.io/docs/release_notes.md#Release-Notes) version in [requirements.txt](./server/requirements.txt). And this tutorial uses [milvus 2.2.10](https://milvus.io/docs/v2.2.x/install_standalone-docker.md) and [pymilvus 2.2.11](https://milvus.io/docs/release_notes.md#2210).
```bash
$ git clone https://github.com/milvus-io/bootcamp.git
$ cd bootcamp/solutions/image/reverse_image_search/server
$ pip install -r requirements.txt
```
- **Set configuration**
```bash
$ vim src/config.py
```
Modify the parameters according to your own environment. Here listing some parameters that need to be set, for more information please refer to [config.py](./server/src/config.py).
| **Parameter** | **Description** | **Default setting** |
| ---------------- | ----------------------------------------------------- | ------------------- |
| MILVUS_HOST | The IP address of Milvus, you can get it by ifconfig. | 127.0.0.1 |
| MILVUS_PORT | Port of Milvus. | 19530 |
| VECTOR_DIMENSION | Dimension of the vectors. | 1000 |
| MYSQL_HOST | The IP address of Mysql. | 127.0.0.1 |
| MYSQL_PORT | Port of Mysql. | 3306 |
| DEFAULT_TABLE | The milvus and mysql default collection name. | milvus_img_search |
- **Run the code**
Then start the server with Fastapi.
```bash
$ python src/main.py
```
- **API Docs**
After starting the service, Please visit `127.0.0.1:5000/docs` in your browser to view all the APIs.
![fastapi](pic/fastapi.png)
> /data: get image by path
>
> /progress: get load progress
>
> /img/load: load images into milvus collection
>
> /img/count: count rows in milvus collection
>
> /img/drop: drop milvus collection & corresponding Mysql table
>
> /img/search: search for most similar image emb in milvus collection and get image info by milvus id in Mysql
### 3. Start Client
Next, start the frontend GUI.
- **Set parameters**
Modify the parameters according to your own environment.
| **Parameter** | **Description** | **example** |
| --------------- | ----------------------------------------------------- | ---------------- |
| **API_HOST** | The IP address of the backend server. | 127.0.0.1 |
| **API_PORT** | The port of the backend server. | 5000 |
```bash
$ export API_HOST='127.0.0.1'
$ export API_PORT='5000'
```
- **Run Docker**
First, build a container by pulling docker image.
```bash
$ docker run -d \
-p 8001:80 \
-e "API_URL=http://${API_HOST}:${API_PORT}" \
milvusbootcamp/img-search-client:2.2.10
```
## How to use front-end
Navigate to `127.0.0.1:8001` in your browser to access the front-end interface.
### 1. Insert data
Enter `/data` in `path/to/your/images`, then click `+` to load the pictures. The following screenshot shows the loading process:
<img src="pic/web2.png" width = "650" height = "500" alt="arch" align=center />
> Notes:
>
> After clicking the Load (+) button, the first time load will take longer time since it needs time to download and prepare models. Please do not click again.
>
> You can check backend status for progress (check in terminal if using source code OR check docker logs of the server container if using docker)
The loading process may take several minutes. The following screenshot shows the interface with images loaded.
<img src="pic/web3.png" width = "650" height = "500" alt="arch" align=center />
### 2.Search for similar images
Select an image to search.
<img src="pic/web5.png" width = "650" height = "500" alt="arch" align=center />
## Code structure
If you are interested in our code or would like to contribute code, feel free to learn more about our code structure.
```bash
Dockerfile
requirements.txt
src
├── __init__.py
├── config.py # Configuration file
├── encode.py # Convert an image to embedding using towhee pipeline (ResNet50)
├── logs.py
├── main.py # Source code to start webserver
├── milvus_helpers.py # Connect to Milvus server and insert/drop/query vectors in Milvus.
├── mysql_helpers.py # Connect to MySQL server, and add/delete/query IDs and object information.
├── operations
│   ├── __init__.py
│   ├── count.py
│   ├── drop.py
│   ├── load.py
│   ├── search.py
│   └── upload.py
└── test_main.py # Pytest file for main.py
```

3
client/.dockerignore Normal file
View File

@ -0,0 +1,3 @@
build
node_modules
yarn-error.log

1
client/.env Normal file
View File

@ -0,0 +1 @@
API_URL=http://192.168.1.85:5000

23
client/.gitignore vendored Executable file
View File

@ -0,0 +1,23 @@
# See https://help.github.com/articles/ignoring-files/ for more about ignoring files.
# dependencies
/node_modules
/.pnp
.pnp.js
# testing
/coverage
# production
/build
# misc
.DS_Store
.env.local
.env.development.local
.env.test.local
.env.production.local
yarn.lock
npm-debug.log*
yarn-debug.log*
yarn-error.log*

36
client/Dockerfile Normal file
View File

@ -0,0 +1,36 @@
# => Build container
FROM node:18-alpine as builder
ENV NODE_ENV=production
ENV NODE_OPTIONS="--openssl-legacy-provider"
WORKDIR /app
COPY package*.json ./
RUN npm install
COPY . .
RUN npm run build
# => Run container
FROM nginx:1.23.1-alpine
# Nginx config
RUN rm -rf /etc/nginx/conf.d
COPY conf /etc/nginx
# Static build
COPY --from=builder /app/build /usr/share/nginx/html/
# Default port exposure
EXPOSE 80
# Copy .env file and shell script to container
WORKDIR /usr/share/nginx/html
COPY ./env.sh .
COPY .env .
# Add bash
RUN apk add --no-cache bash
# Make our shell script executable
RUN chmod +x env.sh
# Start Nginx server
CMD ["/bin/bash", "-c", "/usr/share/nginx/html/env.sh && nginx -g \"daemon off;\""]

View File

@ -0,0 +1,13 @@
server {
listen 80;
location / {
root /usr/share/nginx/html;
index index.html index.htm;
try_files $uri $uri/ /index.html;
expires -1; # Set it to different value depending on your standard requirements
}
error_page 500 502 503 504 /50x.html;
location = /50x.html {
root /usr/share/nginx/html;
}
}

View File

@ -0,0 +1,24 @@
gzip on;
gzip_http_version 1.0;
gzip_comp_level 5; # 1-9
gzip_min_length 256;
gzip_proxied any;
gzip_vary on;
# MIME-types
gzip_types
application/atom+xml
application/javascript
application/json
application/rss+xml
application/vnd.ms-fontobject
application/x-font-ttf
application/x-web-app-manifest+json
application/xhtml+xml
application/xml
font/opentype
image/svg+xml
image/x-icon
text/css
text/plain
text/x-component;

3
client/env-config.js Normal file
View File

@ -0,0 +1,3 @@
window._env_ = {
API_URL: "http://192.168.1.85:5000",
}

29
client/env.sh Executable file
View File

@ -0,0 +1,29 @@
#!/bin/bash
# Recreate config file
rm -rf ./env-config.js
touch ./env-config.js
# Add assignment
echo "window._env_ = {" >> ./env-config.js
# Read each line in .env file
# Each line represents key=value pairs
while read -r line || [[ -n "$line" ]];
do
# Split env variables by character `=`
if printf '%s\n' "$line" | grep -q -e '='; then
varname=$(printf '%s\n' "$line" | sed -e 's/=.*//')
varvalue=$(printf '%s\n' "$line" | sed -e 's/^[^=]*=//')
fi
# Read value of current variable if exists as Environment variable
value=$(printf '%s\n' "${!varname}")
# Otherwise use value from .env file
[[ -z $value ]] && value=${varvalue}
# Append configuration property to JS file
echo " $varname: \"$value\"," >> ./env-config.js
done < .env
echo "}" >> ./env-config.js

34857
client/package-lock.json generated Normal file

File diff suppressed because it is too large Load Diff

43
client/package.json Executable file
View File

@ -0,0 +1,43 @@
{
"name": "milvus-search-demo-react",
"version": "0.1.0",
"private": true,
"resolutions": {
"@types/react": "16.9.0"
},
"dependencies": {
"@material-ui/core": "4.7.1",
"@material-ui/icons": "4.5.1",
"@types/node": "12.0.0",
"@types/react": "16.9.0",
"@types/react-dom": "16.9.0",
"axios": "^0.19.0",
"material-ui-dropzone": "2.4.7",
"react": "16.12.0",
"react-dom": "16.12.0",
"react-images": "1.0.0",
"react-photo-gallery": "8.0.0",
"react-scripts": "3.4.0",
"typescript": "3.7.2"
},
"scripts": {
"start": "react-scripts start",
"build": "react-scripts build",
"eject": "react-scripts eject"
},
"eslintConfig": {
"extends": "react-app"
},
"browserslist": {
"production": [
">0.2%",
"not dead",
"not op_mini all"
],
"development": [
"last 1 chrome version",
"last 1 firefox version",
"last 1 safari version"
]
}
}

BIN
client/public/favicon.ico Executable file

Binary file not shown.

After

Width:  |  Height:  |  Size: 3.8 KiB

BIN
client/public/favicon.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 2.9 KiB

62
client/public/index.html Executable file
View File

@ -0,0 +1,62 @@
<!DOCTYPE html>
<html lang="en">
<head>
<script src="%PUBLIC_URL%/env-config.js"></script>
<meta charset="utf-8" />
<link rel="icon" href="%PUBLIC_URL%/favicon.png" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<meta name="theme-color" content="#000000" />
<meta
name="description"
content="Web site created using create-react-app"
/>
<link rel="apple-touch-icon" href="%PUBLIC_URL%/logo192.png" />
<!--
manifest.json provides metadata used when your web app is installed on a
user's mobile device or desktop. See https://developers.google.com/web/fundamentals/web-app-manifest/
-->
<link rel="manifest" href="%PUBLIC_URL%/manifest.json" />
<!--
Notice the use of %PUBLIC_URL% in the tags above.
It will be replaced with the URL of the `public` folder during the build.
Only files inside the `public` folder can be referenced from the HTML.
Unlike "/favicon.ico" or "favicon.ico", "%PUBLIC_URL%/favicon.ico" will
work correctly both with client-side routing and a non-root public URL.
Learn how to configure a non-root public URL by running `npm run build`.
-->
<style>
html,
body,
#root {
margin: 0;
width: 100%;
height: 100%;
display: flex;
}
p,
h1,
h2,
h3,
h4,
h5 {
margin: 0;
}
</style>
<title>Milvus Demo</title>
</head>
<body>
<noscript>You need to enable JavaScript to run this app.</noscript>
<div id="root"></div>
<!--
This HTML file is a template.
If you open it directly in the browser, you will see an empty page.
You can add webfonts, meta tags, or analytics to this file.
The build step will place the bundled scripts into the <body> tag.
To begin the development, run `npm start` or `yarn start`.
To create a production bundle, use `npm run build` or `yarn build`.
-->
</body>
</html>

BIN
client/public/logo192.png Executable file

Binary file not shown.

After

Width:  |  Height:  |  Size: 5.2 KiB

BIN
client/public/logo512.png Executable file

Binary file not shown.

After

Width:  |  Height:  |  Size: 9.4 KiB

25
client/public/manifest.json Executable file
View File

@ -0,0 +1,25 @@
{
"short_name": "React App",
"name": "Create React App Sample",
"icons": [
{
"src": "favicon.ico",
"sizes": "64x64 32x32 24x24 16x16",
"type": "image/x-icon"
},
{
"src": "logo192.png",
"type": "image/png",
"sizes": "192x192"
},
{
"src": "logo512.png",
"type": "image/png",
"sizes": "512x512"
}
],
"start_url": ".",
"display": "standalone",
"theme_color": "#000000",
"background_color": "#ffffff"
}

2
client/public/robots.txt Executable file
View File

@ -0,0 +1,2 @@
# https://www.robotstxt.org/robotstxt.html
User-agent: *

38
client/src/App.css Executable file
View File

@ -0,0 +1,38 @@
.App {
text-align: center;
}
.App-logo {
height: 40vmin;
pointer-events: none;
}
@media (prefers-reduced-motion: no-preference) {
.App-logo {
animation: App-logo-spin infinite 20s linear;
}
}
.App-header {
background-color: #282c34;
min-height: 100vh;
display: flex;
flex-direction: column;
align-items: center;
justify-content: center;
font-size: calc(10px + 2vmin);
color: white;
}
.App-link {
color: #61dafb;
}
@keyframes App-logo-spin {
from {
transform: rotate(0deg);
}
to {
transform: rotate(360deg);
}
}

45
client/src/App.tsx Executable file
View File

@ -0,0 +1,45 @@
import React, { useState } from "react";
import { createStyles, makeStyles } from "@material-ui/core/styles";
import useMediaQuery from "@material-ui/core/useMediaQuery";
import QueryProvider from "./contexts/QueryContext";
import Setting from "./containers/Setting";
import SearchResults from "./components/SearchResults";
const App: React.FC = () => {
const isMobile = !useMediaQuery("(min-width:1000px)");
const useStyles = makeStyles(() => {
return createStyles({
root: {
flexGrow: 1,
display: isMobile ? "block" : "flex",
overflow: isMobile ? "visible" : "hidden",
},
});
});
const classes = useStyles({});
const [images, setImages]: any = useState([]);
const [loading, setLoading]: any = useState(false);
return (
<QueryProvider>
<div className={classes.root}>
<Setting setImages={setImages} setLoading={setLoading} />
<SearchResults images={images} />
{loading && (
<div
style={{
position: "absolute",
width: "100%",
height: "100%",
left: "0",
top: "0",
backgroundColor: "#000",
opacity: 0.5,
}}
></div>
)}
</div>
</QueryProvider>
);
};
export default App;

View File

@ -0,0 +1,112 @@
import React, { useState } from "react";
import { createStyles, makeStyles } from "@material-ui/core/styles";
import { baseColor } from "../utils/color";
import useMediaQuery from "@material-ui/core/useMediaQuery";
const placeHolderImges = new Array(20).fill({});
const Gallary = (props: any) => {
const isMobile = !useMediaQuery("(min-width:1000px)");
const useStyles = makeStyles((theme) =>
createStyles({
root: {
display: isMobile ? "block:" : "flex",
justifyContent: "flex-start",
alignItems: "center",
flexWrap: "wrap",
},
title: {
marginTop: "20px",
fontSize: "20px",
},
imageContainer: {
position: "relative",
flex: isMobile ? 1 : "0 0 21%",
margin: isMobile ? 0 : "0 15px 15px 0",
paddingTop: isMobile ? "100%" : "20%",
border: "solid 1px #60606F",
display: "flex",
justifyContent: "center",
alignItems: "center",
fontSize: "50px",
width: isMobile ? "100%" : "auto",
height: isMobile ? "0" : "auto",
},
child: {
width: "100%",
maxHeight: "100%",
position: "absolute",
top: `0`,
bottom: `0`,
margin: "auto",
display: "flex",
justifyContent: "center",
alignItems: "center",
color: "#60606F",
fontSize: "8vw",
},
distant: {
fontSize: "1vw",
zIndex: 1000,
color: "#fafafa",
backgroundColor: "#000",
position: "absolute",
bottom: "0px",
left: "0px",
width: "100%",
height: "24px",
display: "flex",
justifyContent: "center",
alignItems: "center",
overflowX: "hidden",
textOverflow: "ellipsis",
whiteSpace: "nowrap",
},
})
);
const { images = [], onClick } = props;
const classes = useStyles({});
const [hovered, setHovered]: any = useState();
const onMouseOver = (e: any) => {
const src = e.currentTarget.dataset.src;
setHovered(src);
};
const onMouseLeave = () => {
setHovered(null);
};
return (
<div className={classes.root}>
{images.length > 0
? images.map((img: any, index: number) => {
const { src, distance } = img;
const isHovered = hovered === src;
return (
<div
className={classes.imageContainer}
onClick={() => {
onClick(index);
}}
onMouseOver={onMouseOver}
onMouseLeave={onMouseLeave}
key={src}
data-src={src}
style={{
border: `solid 2px ${isHovered ? baseColor : "transparent"}`,
}}
>
<img src={src} className={classes.child} alt="" />
{isHovered && (
<p className={classes.distant}>{distance.toFixed(6)}</p>
)}
</div>
);
})
: placeHolderImges.map((item: any, index: number) => (
<div className={classes.imageContainer} key={index}>
<p className={classes.child}>{index < 12 ? index + 1 : ""}</p>
</div>
))}
</div>
);
};
export default Gallary;

View File

@ -0,0 +1,86 @@
import React, {useState, useCallback} from "react";
import {createStyles, makeStyles} from "@material-ui/core/styles";
import Carousel, {Modal, ModalGateway} from "react-images";
import Gallery from "./Gallary";
import {baseColor} from "../utils/color";
import {GetImageUrl} from "../utils/Endpoints";
const useStyles = makeStyles(theme =>
createStyles({
root: {
flexGrow: 1,
overflowX: "hidden",
overflowY: "auto",
padding: "80px 60px",
display: "flex",
flexDirection: "column",
backgroundColor: "#28292E"
},
title: {
margin: "20px 0px 10px",
fontSize: "20px",
color: "#F5F5F5"
},
subTitle: {
fontSize: "15px",
color: "#F1F1F1",
marginBottom: "0px !important"
}
})
);
const SearchResults = props => {
const classes = useStyles({});
const {images = []} = props;
const [currentImage, setCurrentImage] = useState(0);
const [viewerIsOpen, setViewerIsOpen] = useState(false);
const photos = images.map(img => {
return {
src: `${GetImageUrl}?image_path=${img[0]}`,
distance: img[1]
};
});
const openLightbox = useCallback(index => {
setCurrentImage(index);
setViewerIsOpen(true);
}, []);
const closeLightbox = () => {
setCurrentImage(0);
setViewerIsOpen(false);
};
return (
<div className={classes.root}>
<div className={classes.title}>
<h3 className={classes.title}>Search Results</h3>
{photos.length !== 0 && (
<p className={classes.subTitle}>
hover on the image to see{" "}
<span style={{color: baseColor}}>distance</span>(smaller value
represents higher simlarity); click to see the full image
</p>
)}
</div>
<Gallery images={photos} onClick={openLightbox}/>
<ModalGateway>
{viewerIsOpen ? (
<Modal onClose={closeLightbox}>
<Carousel
currentIndex={currentImage}
views={photos.map(x => ({
...x,
srcset: x.srcSet,
caption: x.title
}))}
/>
</Modal>
) : null}
</ModalGateway>
</div>
);
};
export default SearchResults;

View File

@ -0,0 +1,38 @@
import React from "react";
const SeperatLine = (props: any) => {
const { title, style={} } = props;
return (
<div
style={{
display: "flex",
justifyContent: "space-between",
color: "rgba(176,176,185,0.75)",
marginBottom:"10px",
...style,
}}
>
<p style={{ marginRight: "20px"}}>{title}</p>
<div
style={{
flexGrow: 1,
textAlign: "center",
display: "flex",
alignItems: "center",
fontSize:'15px'
}}
>
<hr
style={{
width: "100%",
border: "none",
height: "1px",
backgroundColor: "rgba(176,176,185,0.75)"
}}
/>
</div>
</div>
);
};
export default SeperatLine;

View File

@ -0,0 +1 @@
<svg xmlns="http://www.w3.org/2000/svg" id="Layer_1" data-name="Layer 1" viewBox="0 0 905 400"><defs><style>.cls-2{fill:#33b6f2}</style></defs><path d="M358.87 169.11a16.81 16.81 0 011.56-6.91 11.41 11.41 0 013.61-4.35 14.34 14.34 0 015-2.22A25.61 25.61 0 01375 155a28.93 28.93 0 0110.85 1.81 23.08 23.08 0 015.91 3.12q5.92 12.16 12.41 25.88t13.23 26.54Q423.28 200.5 429 189t10.44-21.86q3.11-7 7.64-9.61A20.51 20.51 0 01457.3 155a31.52 31.52 0 0110.92 1.73 28.24 28.24 0 016 2.71l6.25 108.29h-27.61l-3.78-67.37-6.08 12.46q-3.12 6.41-6 12.65t-5.42 11.91q-2.55 5.67-4.52 10.11h-20.38q-1.8-4.44-4.51-10.35t-5.67-12.33q-3-6.41-6.08-12.73t-5.75-11.59l-3.62 67.21h-27.77zm146.93-7.73a14.44 14.44 0 014.2-10.51 14 14 0 0110.44-4.28 14.62 14.62 0 0114.79 14.79 14 14 0 01-4.28 10.44 14.44 14.44 0 01-10.52 4.18 14.32 14.32 0 01-14.63-14.63zm1.48 34.18q0-6.41 3.78-9t10-2.62a28.47 28.47 0 018 1.06c2.41.72 3.94 1.18 4.6 1.4v81.3h-26.38zm52.72-37.3q0-6.4 3.78-9t10-2.63a28.41 28.41 0 018 1.07c2.41.72 3.94 1.18 4.6 1.4v118.6H560zm77 109.44q-5.1-9-10-18.57t-8.79-17.83q-3.94-8.3-6.57-14.13t-3.29-7.48q-1.3-3.28-2.87-7.39a21.09 21.09 0 01-1.56-7.4 10.49 10.49 0 013.28-7.8q3.28-3.21 9.86-3.2a28.38 28.38 0 018.55 1.06 26.73 26.73 0 013.78 1.4q2.79 8.05 5.91 16.27t6 15.2q2.88 7 5.18 12.32c1.53 3.56 2.63 6.06 3.28 7.48q1-2.13 3.13-7.31t4.68-11.51q2.55-6.31 5.09-12.65T667 195.4a33.22 33.22 0 012.22-4.6 15 15 0 013-3.7 11.7 11.7 0 014.19-2.38 19.39 19.39 0 016.08-.82 24.9 24.9 0 015.92.65A32.43 32.43 0 01693 186a20.87 20.87 0 013.12 1.56c.77.5 1.26.8 1.48.91a62.35 62.35 0 01-3.12 8.95q-2.46 6-5.83 13.72t-7.32 16.19q-3.94 8.46-7.72 16.35t-7.07 14.21q-3.28 6.33-5.09 9.78zm103.37-39.11q0 17.1 15.45 17.09t15.44-17.09v-33q0-6.41 3.78-9t10-2.62a28.47 28.47 0 018 1.06c2.41.72 3.94 1.18 4.6 1.4v47.16a37.23 37.23 0 01-3.21 16 31.49 31.49 0 01-8.79 11.34 38 38 0 01-13.31 6.82 61 61 0 01-33.19 0 38 38 0 01-13.31-6.82 31.49 31.49 0 01-8.79-11.34 37.23 37.23 0 01-3.21-16v-38q0-6.41 3.78-9t10-2.62a28.43 28.43 0 018 1.06c2.41.72 3.94 1.18 4.6 1.4zm85.99 13.47a25.19 25.19 0 004.35 2.39 54.16 54.16 0 007.23 2.63 83.38 83.38 0 009.53 2.13 66.7 66.7 0 0011.26.91q6.74 0 10.19-1.24t3.45-4.35a4.51 4.51 0 00-2.88-4.52 37 37 0 00-9-2L852 237a96.61 96.61 0 01-12.32-2.38 34 34 0 01-10.43-4.6 22.13 22.13 0 01-7.15-7.81 24.49 24.49 0 01-2.63-12 28.28 28.28 0 012.22-11.26 23.5 23.5 0 017-9 35.26 35.26 0 0112.16-6.08 61.53 61.53 0 0117.58-2.22 104.09 104.09 0 0117.83 1.32 45.28 45.28 0 0112.9 4.11 15.51 15.51 0 015 4 9.12 9.12 0 011.89 5.84 9.9 9.9 0 01-1.07 4.68 16 16 0 01-5.09 5.83q-1.23.83-1.56 1a17.91 17.91 0 00-2.71-1.81 32.06 32.06 0 00-5.92-2.55 68.58 68.58 0 00-8.87-2.21 62.94 62.94 0 00-11.75-1q-7.39 0-10.27 1.73a5.13 5.13 0 00-2.88 4.51 4 4 0 002.63 3.95 33.78 33.78 0 007.89 2l15 2.14a75.35 75.35 0 0110.77 2.38 30.15 30.15 0 019.2 4.52 21.51 21.51 0 016.41 7.56 24.16 24.16 0 012.38 11.17q0 13.8-10.52 21.53T860.54 270a98.22 98.22 0 01-30.07-4.35 47.69 47.69 0 01-8.79-3.62 47.15 47.15 0 01-4.69-2.88z" fill="#fff"/><path class="cls-2" d="M212.05 135.73c-39.78-39-104.28-39.06-144.07 0L2.88 199.6a9.55 9.55 0 000 13.67l65.06 63.91c39.78 39.07 104.3 39.09 144.11 0a98.75 98.75 0 000-141.48zm-15.43 122.71a75.84 75.84 0 01-105.86 0l-47.8-47a7 7 0 010-10l47.82-46.93a75.86 75.86 0 01105.85 0 72.54 72.54 0 01-.01 103.93zm100.64-58.77L268.64 171a2.41 2.41 0 00-4.07 2.21 150.35 150.35 0 010 66.51 2.41 2.41 0 004.07 2.21l28.64-28.63a9.66 9.66 0 00-.02-13.63z"/><circle class="cls-2" cx="144.04" cy="206.49" r="50.14"/></svg>

After

Width:  |  Height:  |  Size: 3.4 KiB

View File

@ -0,0 +1,384 @@
import React, { useState, useEffect, useContext, useRef } from "react";
import { queryContext } from "../contexts/QueryContext";
import { createStyles, Theme, makeStyles } from "@material-ui/core/styles";
import useMediaQuery from "@material-ui/core/useMediaQuery";
import TextField from "@material-ui/core/TextField";
import Fab from "@material-ui/core/Fab";
import AddIcon from "@material-ui/icons/Add";
import CloseIcon from "@material-ui/icons/Close";
import Slider from "@material-ui/core/Slider";
import { DropzoneArea } from "material-ui-dropzone";
import SeperatLine from "../components/SeperatLine";
import { baseColor } from "../utils/color";
import Logo from "./Logo.svg";
import { delayRunFunc } from "../utils/Helper";
const Setting = (props: any) => {
const isMobile = !useMediaQuery("(min-width:1000px)");
const useStyles = makeStyles((theme: Theme) => {
return createStyles({
setting: {
display: "flex",
flexDirection: "column",
minWidth: isMobile ? "90%" : "300px",
padding: "60px 20px",
borderWidth: "1px",
backgroundColor: "#1F2023",
color: "#E4E4E6",
overflowY: "auto",
},
header: {
marginBottom: "30px",
display: "flex",
flexDirection: "column",
alignItems: "center",
},
configHead: {
marginBottom: "30px",
display: "flex",
justifyContent: "space-between",
alignItems: "center",
},
config: {
fontSize: "24px",
color: "#FAFAFA",
},
clear: {
color: baseColor,
fontSize: "18px",
cursor: "pointer",
},
imageSet: {},
counts: {
display: "flex",
justifyContent: "space-between",
alignItems: "center",
marginBottom: "30px",
color: "#FAFAFA",
},
currTotal: {
fontSize: "12px",
},
setPath: {
display: "flex",
justifyContent: "start",
alignItems: "center",
marginBottom: "30px",
},
customInput: {
margin: "0 20px 0 0 !important",
color: "blue !important",
width: isMobile ? "80%" : "auto",
},
customFab: {
color: "#fff",
backgroundColor: baseColor,
width: "36px",
height: "36px",
"&:hover": {
backgroundColor: baseColor,
},
},
customDeleteFab: {
position: "absolute",
top: "5px",
right: "5px",
color: "#fff",
backgroundColor: "#666769",
width: "24px",
height: "24px",
minHeight: "0px",
"&:hover": {
backgroundColor: "#666769",
},
},
customDelete: {
color: "#A7A7AF",
width: "18px",
height: "18px",
},
customIcon: {
color: "#fff",
backgroundColor: baseColor,
width: "20px",
height: "20px",
},
customSlider: {
color: baseColor,
marginBottom: "30px",
},
thumb: {
width: "16px",
height: "16px",
},
track: {
height: "4px",
borderRadius: "10px",
},
upload: {
display: "flex",
justifyContent: "center",
alignItems: "center",
},
benchImage: {
width: "400px",
height: "250px",
position: "relative",
},
dropzoneContainer: {
backgroundColor: "transparent",
width: "250px",
height: "250px",
borderRadius: "10px",
border: "solid .5px #C8C8C8",
display: "flex",
justifyContent: "center",
alignItems: "center",
},
dropzoneText: {
fontSize: "14px",
color: "#B3B4B5",
marginBottom: "30px",
},
notchedOutline: {
borderWidth: ".5px",
borderColor: "#838385 !important",
},
formLabel: {
color: "#fff",
},
controlLabel: {
color: "#838385",
},
});
});
const { process, train, count, search, clearAll } = useContext(queryContext);
const { setImages, loading, setLoading } = props;
const classes = useStyles({});
const [inputs, setInputs]: any = useState("");
const [topK, setTopK]: any = useState(5);
const [totalNum, setTotalNum]: any = useState(0);
const [[current, total], setProcessedNum]: any = useState([0, 0]);
const [image, setImage]: any = useState();
const benchImage = useRef<any>(null);
const setText = loading
? "Loading..."
: totalNum
? `${totalNum} images in this set`
: "No image in this set";
const reader = new FileReader();
reader.addEventListener(
"load",
function () {
if (benchImage.current) {
benchImage.current.src = reader.result;
}
},
false
);
const _search = ({ topK, image }: any) => {
const fd = new FormData();
fd.set("topk", topK);
fd.append("image", image);
search(fd).then((res: any) => {
const { status, data } = res || {};
if (status === 200) {
setImages(data);
}
});
};
const uploadImg = (file: any) => {
setImage(file);
reader.readAsDataURL(file);
_search({ topK, image: file });
};
const onInputChange = (e: any) => {
const val = e.target.value;
setInputs(val);
};
const onTopKChange = (e: any, val: any) => {
setTopK(val);
if (val && image) {
delayRunFunc({ topK: val, image }, _search, 300);
}
};
const _keepProcess = () => {
process().then((res: any) => {
const { data, status } = res;
if (status === 200) {
const [_current, _total] = data
.split(",")
.map((item: any) => Number.parseInt(item.split(":")[1]));
setProcessedNum([_current, _total]);
if (_current !== _total) {
setTimeout(() => _keepProcess(), 1000);
} else {
setTimeout(() => {
count().then((res: any) => {
const { data, status } = res;
if (status === 200) {
setTotalNum(data);
setLoading(false);
}
});
}, 3000);
}
}
});
};
const uploadImgPath = () => {
train({ File: inputs }).then((res: any) => {
if (res.status === 200) {
setLoading(true);
setTimeout(() => {
setInputs("");
_keepProcess();
}, 1000);
}
});
};
const clear = () => {
clearAll().then((res: any) => {
if (res.status === 200) {
setProcessedNum([0, 0]);
setTotalNum(0);
setImage();
setImages([]);
}
});
};
useEffect(() => {
count().then((res: any) => {
const { data, status } = res || {};
if (status === 200) {
setTotalNum(data);
}
});
// eslint-disable-next-line react-hooks/exhaustive-deps
}, []);
return (
<div className={classes.setting}>
<div className={classes.header}>
<img src={Logo} width="150px" alt="logo" />
<p>Image Search Demo</p>
</div>
<div className={classes.configHead}>
<h4 className={classes.config}>Config</h4>
<h4 className={classes.clear} onClick={clear}>
CLEAR ALL
</h4>
</div>
<SeperatLine title={`IMAGE SET`} style={{ marginBottom: "20px" }} />
<div className={classes.imageSet}>
<div className={classes.counts}>
<p style={{ color: loading ? baseColor : "#fff" }}>{setText}</p>
<h3 className={classes.currTotal}>{`${current}/${total}`}</h3>
</div>
<div className={classes.setPath}>
<TextField
classes={{ root: classes.customInput }}
label=""
variant="outlined"
value={inputs}
onChange={onInputChange}
InputLabelProps={{
shrink: true,
classes: {
root: classes.controlLabel,
focused: classes.controlLabel,
},
}}
margin="normal"
InputProps={{
style: {
textAlign: "left",
width: isMobile ? "100%" : "340px",
height: "40px",
},
classes: {
notchedOutline: classes.notchedOutline,
root: classes.formLabel,
},
placeholder: "path/to/your/images",
}}
/>
<Fab
classes={{
root: classes.customFab,
focusVisible: classes.customFab,
}}
>
<AddIcon
onClick={uploadImgPath}
classes={{ root: classes.customIcon }}
/>
</Fab>
</div>
<SeperatLine title={`TOP K(1100)`} style={{ marginBottom: "20px" }} />
<div className={classes.counts}>
<p>{`show top ${topK} results`}</p>
</div>
<Slider
min={1}
max={100}
value={topK}
onChange={onTopKChange}
classes={{
root: classes.customSlider,
track: classes.track,
rail: classes.track,
thumb: classes.thumb,
}}
/>
</div>
<SeperatLine title={`ORIGINAL IMAGE`} style={{ marginBottom: "50px" }} />
<div className={classes.upload}>
{image ? (
<div className={classes.benchImage}>
<img
ref={benchImage}
className={classes.benchImage}
src={image}
alt="..."
/>
<Fab
color="primary"
aria-label="add"
size="small"
classes={{ root: classes.customDeleteFab }}
>
<CloseIcon
onClick={() => {
setImage();
setImages([]);
}}
classes={{ root: classes.customDelete }}
/>
</Fab>
</div>
) : (
<DropzoneArea
acceptedFiles={["image/*"]}
filesLimit={1}
dropzoneText={`click to upload / drag a image here`}
onDrop={uploadImg}
dropzoneClass={classes.dropzoneContainer}
showPreviewsInDropzone={false}
dropzoneParagraphClass={classes.dropzoneText}
// maxFileSize={} bit
/>
)}
</div>
</div>
);
};
export default Setting;

View File

@ -0,0 +1,51 @@
import React, { FC, createContext, ReactNode } from "react";
import axios from "axios";
import * as URL from "../utils/Endpoints";
const axiosInstance = axios.create();
export const queryContext = createContext<any>({});
const Provider = queryContext.Provider;
const QueryProvider: FC<{ children: ReactNode }> = ({ children }) => {
const errorParser = (e: any) => {
console.log(e);
};
const process = async (params: any) => {
const url = URL.Processing;
return await axiosInstance.get(url, params).catch(errorParser);
};
const count = async (params: any) => {
const url = URL.Count;
return await axiosInstance.post(url, params).catch(errorParser);
};
const train = async (params: any) => {
const url = URL.Train;
return await axiosInstance.post(url, params).catch(errorParser);
};
const search = async (params: any) => {
const url = URL.Search;
return await axiosInstance.post(url, params).catch(errorParser);
};
const clearAll = async () => {
const url = URL.ClearAll;
return await axiosInstance.post(url).catch(errorParser);
};
return (
<Provider
value={{
process,
count,
search,
clearAll,
train
}}
>
{children}
</Provider>
);
};
export default QueryProvider;

13
client/src/index.css Executable file
View File

@ -0,0 +1,13 @@
body {
margin: 0;
font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', 'Roboto', 'Oxygen',
'Ubuntu', 'Cantarell', 'Fira Sans', 'Droid Sans', 'Helvetica Neue',
sans-serif;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
}
code {
font-family: source-code-pro, Menlo, Monaco, Consolas, 'Courier New',
monospace;
}

12
client/src/index.tsx Executable file
View File

@ -0,0 +1,12 @@
import React from 'react';
import ReactDOM from 'react-dom';
import './index.css';
import App from './App';
import * as serviceWorker from './serviceWorker';
ReactDOM.render(<App />, document.getElementById('root'));
// If you want your app to work offline and load faster, you can change
// unregister() to register() below. Note this comes with some pitfalls.
// Learn more about service workers: https://bit.ly/CRA-PWA
serviceWorker.unregister();

7
client/src/logo.svg Executable file
View File

@ -0,0 +1,7 @@
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 841.9 595.3">
<g fill="#61DAFB">
<path d="M666.3 296.5c0-32.5-40.7-63.3-103.1-82.4 14.4-63.6 8-114.2-20.2-130.4-6.5-3.8-14.1-5.6-22.4-5.6v22.3c4.6 0 8.3.9 11.4 2.6 13.6 7.8 19.5 37.5 14.9 75.7-1.1 9.4-2.9 19.3-5.1 29.4-19.6-4.8-41-8.5-63.5-10.9-13.5-18.5-27.5-35.3-41.6-50 32.6-30.3 63.2-46.9 84-46.9V78c-27.5 0-63.5 19.6-99.9 53.6-36.4-33.8-72.4-53.2-99.9-53.2v22.3c20.7 0 51.4 16.5 84 46.6-14 14.7-28 31.4-41.3 49.9-22.6 2.4-44 6.1-63.6 11-2.3-10-4-19.7-5.2-29-4.7-38.2 1.1-67.9 14.6-75.8 3-1.8 6.9-2.6 11.5-2.6V78.5c-8.4 0-16 1.8-22.6 5.6-28.1 16.2-34.4 66.7-19.9 130.1-62.2 19.2-102.7 49.9-102.7 82.3 0 32.5 40.7 63.3 103.1 82.4-14.4 63.6-8 114.2 20.2 130.4 6.5 3.8 14.1 5.6 22.5 5.6 27.5 0 63.5-19.6 99.9-53.6 36.4 33.8 72.4 53.2 99.9 53.2 8.4 0 16-1.8 22.6-5.6 28.1-16.2 34.4-66.7 19.9-130.1 62-19.1 102.5-49.9 102.5-82.3zm-130.2-66.7c-3.7 12.9-8.3 26.2-13.5 39.5-4.1-8-8.4-16-13.1-24-4.6-8-9.5-15.8-14.4-23.4 14.2 2.1 27.9 4.7 41 7.9zm-45.8 106.5c-7.8 13.5-15.8 26.3-24.1 38.2-14.9 1.3-30 2-45.2 2-15.1 0-30.2-.7-45-1.9-8.3-11.9-16.4-24.6-24.2-38-7.6-13.1-14.5-26.4-20.8-39.8 6.2-13.4 13.2-26.8 20.7-39.9 7.8-13.5 15.8-26.3 24.1-38.2 14.9-1.3 30-2 45.2-2 15.1 0 30.2.7 45 1.9 8.3 11.9 16.4 24.6 24.2 38 7.6 13.1 14.5 26.4 20.8 39.8-6.3 13.4-13.2 26.8-20.7 39.9zm32.3-13c5.4 13.4 10 26.8 13.8 39.8-13.1 3.2-26.9 5.9-41.2 8 4.9-7.7 9.8-15.6 14.4-23.7 4.6-8 8.9-16.1 13-24.1zM421.2 430c-9.3-9.6-18.6-20.3-27.8-32 9 .4 18.2.7 27.5.7 9.4 0 18.7-.2 27.8-.7-9 11.7-18.3 22.4-27.5 32zm-74.4-58.9c-14.2-2.1-27.9-4.7-41-7.9 3.7-12.9 8.3-26.2 13.5-39.5 4.1 8 8.4 16 13.1 24 4.7 8 9.5 15.8 14.4 23.4zM420.7 163c9.3 9.6 18.6 20.3 27.8 32-9-.4-18.2-.7-27.5-.7-9.4 0-18.7.2-27.8.7 9-11.7 18.3-22.4 27.5-32zm-74 58.9c-4.9 7.7-9.8 15.6-14.4 23.7-4.6 8-8.9 16-13 24-5.4-13.4-10-26.8-13.8-39.8 13.1-3.1 26.9-5.8 41.2-7.9zm-90.5 125.2c-35.4-15.1-58.3-34.9-58.3-50.6 0-15.7 22.9-35.6 58.3-50.6 8.6-3.7 18-7 27.7-10.1 5.7 19.6 13.2 40 22.5 60.9-9.2 20.8-16.6 41.1-22.2 60.6-9.9-3.1-19.3-6.5-28-10.2zM310 490c-13.6-7.8-19.5-37.5-14.9-75.7 1.1-9.4 2.9-19.3 5.1-29.4 19.6 4.8 41 8.5 63.5 10.9 13.5 18.5 27.5 35.3 41.6 50-32.6 30.3-63.2 46.9-84 46.9-4.5-.1-8.3-1-11.3-2.7zm237.2-76.2c4.7 38.2-1.1 67.9-14.6 75.8-3 1.8-6.9 2.6-11.5 2.6-20.7 0-51.4-16.5-84-46.6 14-14.7 28-31.4 41.3-49.9 22.6-2.4 44-6.1 63.6-11 2.3 10.1 4.1 19.8 5.2 29.1zm38.5-66.7c-8.6 3.7-18 7-27.7 10.1-5.7-19.6-13.2-40-22.5-60.9 9.2-20.8 16.6-41.1 22.2-60.6 9.9 3.1 19.3 6.5 28.1 10.2 35.4 15.1 58.3 34.9 58.3 50.6-.1 15.7-23 35.6-58.4 50.6zM320.8 78.4z"/>
<circle cx="420.9" cy="296.5" r="45.7"/>
<path d="M520.5 78.1z"/>
</g>
</svg>

After

Width:  |  Height:  |  Size: 2.6 KiB

1
client/src/react-app-env.d.ts vendored Executable file
View File

@ -0,0 +1 @@
/// <reference types="react-scripts" />

145
client/src/serviceWorker.ts Executable file
View File

@ -0,0 +1,145 @@
// This optional code is used to register a service worker.
// register() is not called by default.
// This lets the app load faster on subsequent visits in production, and gives
// it offline capabilities. However, it also means that developers (and users)
// will only see deployed updates on subsequent visits to a page, after all the
// existing tabs open on the page have been closed, since previously cached
// resources are updated in the background.
// To learn more about the benefits of this model and instructions on how to
// opt-in, read https://bit.ly/CRA-PWA
const isLocalhost = Boolean(
window.location.hostname === 'localhost' ||
// [::1] is the IPv6 localhost address.
window.location.hostname === '[::1]' ||
// 127.0.0.0/8 are considered localhost for IPv4.
window.location.hostname.match(
/^127(?:\.(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)){3}$/
)
);
type Config = {
onSuccess?: (registration: ServiceWorkerRegistration) => void;
onUpdate?: (registration: ServiceWorkerRegistration) => void;
};
export function register(config?: Config) {
if (process.env.NODE_ENV === 'production' && 'serviceWorker' in navigator) {
// The URL constructor is available in all browsers that support SW.
const publicUrl = new URL(
process.env.PUBLIC_URL,
window.location.href
);
if (publicUrl.origin !== window.location.origin) {
// Our service worker won't work if PUBLIC_URL is on a different origin
// from what our page is served on. This might happen if a CDN is used to
// serve assets; see https://github.com/facebook/create-react-app/issues/2374
return;
}
window.addEventListener('load', () => {
const swUrl = `${process.env.PUBLIC_URL}/service-worker.js`;
if (isLocalhost) {
// This is running on localhost. Let's check if a service worker still exists or not.
checkValidServiceWorker(swUrl, config);
// Add some additional logging to localhost, pointing developers to the
// service worker/PWA documentation.
navigator.serviceWorker.ready.then(() => {
console.log(
'This web app is being served cache-first by a service ' +
'worker. To learn more, visit https://bit.ly/CRA-PWA'
);
});
} else {
// Is not localhost. Just register service worker
registerValidSW(swUrl, config);
}
});
}
}
function registerValidSW(swUrl: string, config?: Config) {
navigator.serviceWorker
.register(swUrl)
.then(registration => {
registration.onupdatefound = () => {
const installingWorker = registration.installing;
if (installingWorker == null) {
return;
}
installingWorker.onstatechange = () => {
if (installingWorker.state === 'installed') {
if (navigator.serviceWorker.controller) {
// At this point, the updated precached content has been fetched,
// but the previous service worker will still serve the older
// content until all client tabs are closed.
console.log(
'New content is available and will be used when all ' +
'tabs for this page are closed. See https://bit.ly/CRA-PWA.'
);
// Execute callback
if (config && config.onUpdate) {
config.onUpdate(registration);
}
} else {
// At this point, everything has been precached.
// It's the perfect time to display a
// "Content is cached for offline use." message.
console.log('Content is cached for offline use.');
// Execute callback
if (config && config.onSuccess) {
config.onSuccess(registration);
}
}
}
};
};
})
.catch(error => {
console.error('Error during service worker registration:', error);
});
}
function checkValidServiceWorker(swUrl: string, config?: Config) {
// Check if the service worker can be found. If it can't reload the page.
fetch(swUrl, {
headers: { 'Service-Worker': 'script' }
})
.then(response => {
// Ensure service worker exists, and that we really are getting a JS file.
const contentType = response.headers.get('content-type');
if (
response.status === 404 ||
(contentType != null && contentType.indexOf('javascript') === -1)
) {
// No service worker found. Probably a different app. Reload the page.
navigator.serviceWorker.ready.then(registration => {
registration.unregister().then(() => {
window.location.reload();
});
});
} else {
// Service worker found. Proceed as normal.
registerValidSW(swUrl, config);
}
})
.catch(() => {
console.log(
'No internet connection found. App is running in offline mode.'
);
});
}
export function unregister() {
if ('serviceWorker' in navigator) {
navigator.serviceWorker.ready.then(registration => {
registration.unregister();
});
}
}

5
client/src/setupTests.ts Executable file
View File

@ -0,0 +1,5 @@
// jest-dom adds custom jest matchers for asserting on DOM nodes.
// allows you to do things like:
// expect(element).toHaveTextContent(/react/i)
// learn more: https://github.com/testing-library/jest-dom
import '@testing-library/jest-dom/extend-expect';

View File

@ -0,0 +1,6 @@
import { createStyles, Theme, makeStyles } from "@material-ui/core/styles";
export const createStyle = (style: any) => {
const useStyles = makeStyles((theme: Theme) => createStyles(style));
return useStyles({});
};

View File

@ -0,0 +1,17 @@
declare global {
interface Window {
_env_: any;
}
}
let endpoint = `http://172.16.20.10:5000`;
if (window._env_ && window._env_.API_URL) {
endpoint = window._env_.API_URL;
}
export const Train = `${endpoint}/img/load`;
export const Processing = `${endpoint}/progress`;
export const Count = `${endpoint}/img/count`;
export const ClearAll = `${endpoint}/img/drop`;
export const Search = `${endpoint}/img/search`;
export const GetImageUrl = `${endpoint}/data`;

View File

@ -0,0 +1,13 @@
let timeout: any = '';
export const delayRunFunc = (params: any, func: Function, time: number) => {
if (timeout) {
clearTimeout(timeout);
}
timeout = setTimeout(() => {
func(params);
}, time);
const r = () => {
clearTimeout(timeout);
};
return r;
};

View File

@ -0,0 +1 @@
export const baseColor = '#3F9CD1';

25
client/tsconfig.json Executable file
View File

@ -0,0 +1,25 @@
{
"compilerOptions": {
"target": "es5",
"lib": [
"dom",
"dom.iterable",
"esnext"
],
"allowJs": true,
"skipLibCheck": true,
"esModuleInterop": true,
"allowSyntheticDefaultImports": true,
"strict": true,
"forceConsistentCasingInFileNames": true,
"module": "esnext",
"moduleResolution": "node",
"resolveJsonModule": true,
"isolatedModules": true,
"noEmit": true,
"jsx": "react"
},
"include": [
"src"
]
}

106
docker-compose.yaml Normal file
View File

@ -0,0 +1,106 @@
version: '3.5'
services:
etcd:
container_name: milvus-etcd
image: quay.io/coreos/etcd:v3.5.5
networks:
app_net:
environment:
- ETCD_AUTO_COMPACTION_MODE=revision
- ETCD_AUTO_COMPACTION_RETENTION=1000
- ETCD_QUOTA_BACKEND_BYTES=4294967296
- ETCD_SNAPSHOT_COUNT=50000
volumes:
- ${DOCKER_VOLUME_DIRECTORY:-.}/volumes/etcd:/etcd
command: etcd -advertise-client-urls=http://127.0.0.1:2379 -listen-client-urls http://0.0.0.0:2379 --data-dir /etcd
minio:
container_name: milvus-minio
image: minio/minio:RELEASE.2023-03-20T20-16-18Z
networks:
app_net:
environment:
MINIO_ACCESS_KEY: minioadmin
MINIO_SECRET_KEY: minioadmin
volumes:
- ${DOCKER_VOLUME_DIRECTORY:-.}/volumes/minio:/minio_data
command: minio server /minio_data
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
interval: 30s
timeout: 20s
retries: 3
standalone:
container_name: milvus-standalone
image: milvusdb/milvus:v2.2.10
networks:
app_net:
ipv4_address: 172.16.238.10
command: ["milvus", "run", "standalone"]
environment:
ETCD_ENDPOINTS: etcd:2379
MINIO_ADDRESS: minio:9000
volumes:
- ${DOCKER_VOLUME_DIRECTORY:-.}/volumes/milvus:/var/lib/milvus
ports:
- "19530:19530"
- "9091:9091"
depends_on:
- "etcd"
- "minio"
mysql:
container_name: img-search-mysql
image: mysql:5.7
networks:
app_net:
ipv4_address: 172.16.238.11
environment:
- MYSQL_ROOT_PASSWORD=123456
ports:
- "3306:3306"
webserver:
container_name: img-search-webserver
image: milvusbootcamp/img-search-server:2.2.10
networks:
app_net:
ipv4_address: 172.16.238.12
environment:
MILVUS_HOST: '172.16.238.10'
MYSQL_HOST: '172.16.238.11'
volumes:
- ./data:/data
restart: always
depends_on:
- standalone
- mysql
ports:
- "5000:5000"
webclient:
container_name: img-search-webclient
image: milvusbootcamp/img-search-client:2.2.10
networks:
app_net:
ipv4_address: 172.16.238.13
environment:
API_URL: 'http://127.0.0.1:5000'
ports:
- "8001:80"
healthcheck:
test: ["CMD", "curl", "-f", "http://127.0.0.1:8001"]
interval: 30s
timeout: 20s
retries: 3
networks:
app_net:
driver: bridge
ipam:
driver: default
config:
- subnet: 172.16.238.0/24
gateway: 172.16.238.1

BIN
pic/fastapi.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 174 KiB

BIN
pic/web1.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 85 KiB

BIN
pic/web2.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 137 KiB

BIN
pic/web3.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 149 KiB

BIN
pic/web4.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 141 KiB

BIN
pic/web5.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 846 KiB

BIN
pic/workflow.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 354 KiB

13
server/Dockerfile Normal file
View File

@ -0,0 +1,13 @@
FROM python:3.7-slim-buster
RUN pip3 install --upgrade pip
RUN apt-get update
RUN apt-get install ffmpeg libsm6 libxext6 -y
WORKDIR /app/src
COPY . /app
RUN pip3 install -r /app/requirements.txt
RUN python3 encode.py
CMD python3 main.py

13
server/requirements.txt Normal file
View File

@ -0,0 +1,13 @@
PyMySQL==1.0.2
scipy
diskcache==5.2.1
uvicorn==0.13.4
numpy==1.21.3
pydantic==1.8.2
pymilvus==2.2.11
towhee==1.1.0
towhee.models==1.1.0
fastapi==0.65.2
python-multipart==0.0.5
pillow==8.4.0
aiofiles==0.7.0

0
server/src/__init__.py Normal file
View File

23
server/src/config.py Normal file
View File

@ -0,0 +1,23 @@
import os
############### Milvus Configuration ###############
MILVUS_HOST = os.getenv("MILVUS_HOST", "127.0.0.1")
MILVUS_PORT = int(os.getenv("MILVUS_PORT", "19530"))
VECTOR_DIMENSION = int(os.getenv("VECTOR_DIMENSION", "2048"))
INDEX_FILE_SIZE = int(os.getenv("INDEX_FILE_SIZE", "1024"))
METRIC_TYPE = os.getenv("METRIC_TYPE", "L2")
DEFAULT_TABLE = os.getenv("DEFAULT_TABLE", "milvus_img_search")
TOP_K = int(os.getenv("TOP_K", "10"))
############### MySQL Configuration ###############
MYSQL_HOST = os.getenv("MYSQL_HOST", "127.0.0.1")
MYSQL_PORT = int(os.getenv("MYSQL_PORT", "3306"))
MYSQL_USER = os.getenv("MYSQL_USER", "root")
MYSQL_PWD = os.getenv("MYSQL_PWD", "123456")
MYSQL_DB = os.getenv("MYSQL_DB", "mysql")
############### Data Path ###############
UPLOAD_PATH = os.getenv("UPLOAD_PATH", "tmp/search-images")
############### Number of log files ###############
LOGS_NUM = int(os.getenv("logs_num", "0"))

22
server/src/encode.py Normal file
View File

@ -0,0 +1,22 @@
from towhee import pipe, ops
class Resnet50:
def __init__(self):
self.image_embedding_pipe = (
pipe.input('path')
.map('path', 'img', ops.image_decode.cv2_rgb())
.map('img', 'embedding', ops.image_embedding.timm(model_name='resnet50'))
.map('embedding', 'embedding', ops.towhee.np_normalize())
.output('embedding')
)
def resnet50_extract_feat(self, img_path):
feat = self.image_embedding_pipe(img_path)
return feat.get()[0]
if __name__ == '__main__':
MODEL = Resnet50()
# Warm up the model to build image
MODEL.resnet50_extract_feat('https://raw.githubusercontent.com/towhee-io/towhee/main/towhee_logo.png')

129
server/src/logs.py Normal file
View File

@ -0,0 +1,129 @@
import os
import re
import datetime
import logging
import sys
from config import LOGS_NUM
try:
import codecs
except ImportError:
codecs = None
class MultiprocessHandler(logging.FileHandler):
"""
Say something about the ExampleCalass...
Args:
args_0 (`type`):
...
"""
def __init__(self, filename, when='D', backupCount=0, encoding=None, delay=False):
self.prefix = filename
self.backupCount = backupCount
self.when = when.upper()
self.extMath = r"^\d{4}-\d{2}-\d{2}"
self.when_dict = {
'S': "%Y-%m-%d-%H-%M-%S",
'M': "%Y-%m-%d-%H-%M",
'H': "%Y-%m-%d-%H",
'D': "%Y-%m-%d"
}
self.suffix = self.when_dict.get(when)
if not self.suffix:
print('The specified date interval unit is invalid: ', self.when)
sys.exit(1)
self.filefmt = os.path.join('.', "logs", f"{self.prefix}-{self.suffix}.log")
self.filePath = datetime.datetime.now().strftime(self.filefmt)
_dir = os.path.dirname(self.filefmt)
try:
if not os.path.exists(_dir):
os.makedirs(_dir)
except Exception as e:
print('Failed to create log file: ', e)
print("log_path" + self.filePath)
sys.exit(1)
if codecs is None:
encoding = None
logging.FileHandler.__init__(self, self.filePath, 'a+', encoding, delay)
def shouldChangeFileToWrite(self):
_filePath = datetime.datetime.now().strftime(self.filefmt)
if _filePath != self.filePath:
self.filePath = _filePath
return True
return False
def doChangeFile(self):
self.baseFilename = os.path.abspath(self.filePath)
if self.stream:
self.stream.close()
self.stream = None
if not self.delay:
self.stream = self._open()
if self.backupCount > 0:
for s in self.getFilesToDelete():
os.remove(s)
def getFilesToDelete(self):
dir_name, _ = os.path.split(self.baseFilename)
file_names = os.listdir(dir_name)
result = []
prefix = self.prefix + '-'
for file_name in file_names:
if file_name[:len(prefix)] == prefix:
suffix = file_name[len(prefix):-4]
if re.compile(self.extMath).match(suffix):
result.append(os.path.join(dir_name, file_name))
result.sort()
if len(result) < self.backupCount:
result = []
else:
result = result[:len(result) - self.backupCount]
return result
def emit(self, record):
try:
if self.shouldChangeFileToWrite():
self.doChangeFile()
logging.FileHandler.emit(self, record)
except (KeyboardInterrupt, SystemExit):
raise
except:
self.handleError(record)
def write_log():
logger = logging.getLogger()
logger.setLevel(logging.DEBUG)
# formatter = '%(asctime)s %(levelname)s %(filename)s %(funcName)s %(module)s %(lineno)s %(message)s'
fmt = logging.Formatter(
'%(asctime)s %(levelname)s %(filename)s %(funcName)s %(lineno)s %(message)s')
stream_handler = logging.StreamHandler(sys.stdout)
stream_handler.setLevel(logging.INFO)
stream_handler.setFormatter(fmt)
log_name = "milvus"
file_handler = MultiprocessHandler(log_name, when='D', backupCount=LOGS_NUM)
file_handler.setLevel(logging.DEBUG)
file_handler.setFormatter(fmt)
file_handler.doChangeFile()
logger.addHandler(stream_handler)
logger.addHandler(file_handler)
return logger
LOGGER = write_log()

143
server/src/main.py Normal file
View File

@ -0,0 +1,143 @@
import uvicorn
import os
from diskcache import Cache
from fastapi import FastAPI, File, UploadFile
from fastapi.param_functions import Form
from starlette.middleware.cors import CORSMiddleware
from starlette.responses import FileResponse
from encode import Resnet50
from milvus_helpers import MilvusHelper
from mysql_helpers import MySQLHelper
from config import TOP_K, UPLOAD_PATH
from operations.load import do_load
from operations.upload import do_upload
from operations.search import do_search
from operations.count import do_count
from operations.drop import do_drop
from logs import LOGGER
from pydantic import BaseModel
from typing import Optional
from urllib.request import urlretrieve
app = FastAPI()
origins = ["*"]
app.add_middleware(
CORSMiddleware,
allow_origins=origins,
allow_credentials=True,
allow_methods=["*"],
allow_headers=["*"],
)
MODEL = Resnet50()
MILVUS_CLI = MilvusHelper()
MYSQL_CLI = MySQLHelper()
# Mkdir '/tmp/search-images'
if not os.path.exists(UPLOAD_PATH):
os.makedirs(UPLOAD_PATH)
LOGGER.info(f"mkdir the path:{UPLOAD_PATH}")
@app.get('/data')
def get_img(image_path):
# Get the image file
try:
LOGGER.info(f"Successfully load image: {image_path}")
return FileResponse(image_path)
except Exception as e:
LOGGER.error(f"Get image error: {e}")
return {'status': False, 'msg': e}, 400
@app.get('/progress')
def get_progress():
# Get the progress of dealing with images
try:
cache = Cache('./tmp')
return f"current: {cache['current']}, total: {cache['total']}"
except Exception as e:
LOGGER.error(f"upload image error: {e}")
return {'status': False, 'msg': e}, 400
class Item(BaseModel):
Table: Optional[str] = None
File: str
@app.post('/img/load')
async def load_images(item: Item):
# Insert all the image under the file path to Milvus/MySQL
try:
total_num = do_load(item.Table, item.File, MODEL, MILVUS_CLI, MYSQL_CLI)
LOGGER.info(f"Successfully loaded data, total count: {total_num}")
return "Successfully loaded data!"
except Exception as e:
LOGGER.error(e)
return {'status': False, 'msg': e}, 400
@app.post('/img/upload')
async def upload_images(image: UploadFile = File(None), url: str = None, table_name: str = None):
# Insert the upload image to Milvus/MySQL
try:
# Save the upload image to server.
if image is not None:
content = await image.read()
img_path = os.path.join(UPLOAD_PATH, image.filename)
with open(img_path, "wb+") as f:
f.write(content)
elif url is not None:
img_path = os.path.join(UPLOAD_PATH, os.path.basename(url))
urlretrieve(url, img_path)
else:
return {'status': False, 'msg': 'Image and url are required'}, 400
vector_id = do_upload(table_name, img_path, MODEL, MILVUS_CLI, MYSQL_CLI)
LOGGER.info(f"Successfully uploaded data, vector id: {vector_id}")
return "Successfully loaded data: " + str(vector_id)
except Exception as e:
LOGGER.error(e)
return {'status': False, 'msg': e}, 400
@app.post('/img/search')
async def search_images(image: UploadFile = File(...), topk: int = Form(TOP_K), table_name: str = None):
# Search the upload image in Milvus/MySQL
try:
# Save the upload image to server.
content = await image.read()
img_path = os.path.join(UPLOAD_PATH, image.filename)
with open(img_path, "wb+") as f:
f.write(content)
paths, distances = do_search(table_name, img_path, topk, MODEL, MILVUS_CLI, MYSQL_CLI)
res = dict(zip(paths, distances))
res = sorted(res.items(), key=lambda item: item[1])
LOGGER.info("Successfully searched similar images!")
return res
except Exception as e:
LOGGER.error(e)
return {'status': False, 'msg': e}, 400
@app.post('/img/count')
async def count_images(table_name: str = None):
# Returns the total number of images in the system
try:
num = do_count(table_name, MILVUS_CLI)
LOGGER.info("Successfully count the number of images!")
return num
except Exception as e:
LOGGER.error(e)
return {'status': False, 'msg': e}, 400
@app.post('/img/drop')
async def drop_tables(table_name: str = None):
# Delete the collection of Milvus and MySQL
try:
status = do_drop(table_name, MILVUS_CLI, MYSQL_CLI)
LOGGER.info("Successfully drop tables in Milvus and MySQL!")
return status
except Exception as e:
LOGGER.error(e)
return {'status': False, 'msg': e}, 400
if __name__ == '__main__':
uvicorn.run(app=app, host='0.0.0.0', port=5000)

View File

@ -0,0 +1,113 @@
import sys
from config import MILVUS_HOST, MILVUS_PORT, VECTOR_DIMENSION, METRIC_TYPE
from pymilvus import connections, FieldSchema, CollectionSchema, DataType, Collection, utility
from logs import LOGGER
class MilvusHelper:
"""
Milvus Helper
"""
def __init__(self):
try:
self.collection = None
connections.connect(host=MILVUS_HOST, port=MILVUS_PORT)
LOGGER.debug(f"Successfully connect to Milvus with IP:{MILVUS_HOST} and PORT:{MILVUS_PORT}")
except Exception as e:
LOGGER.error(f"Failed to connect Milvus: {e}")
sys.exit(1)
def set_collection(self, collection_name):
try:
self.collection = Collection(name=collection_name)
except Exception as e:
LOGGER.error(f"Failed to set collection in Milvus: {e}")
sys.exit(1)
def has_collection(self, collection_name):
# Return if Milvus has the collection
try:
return utility.has_collection(collection_name)
except Exception as e:
LOGGER.error(f"Failed to get collection info to Milvus: {e}")
sys.exit(1)
def create_collection(self, collection_name):
# Create milvus collection if not exists
try:
field1 = FieldSchema(name="id", dtype=DataType.INT64, description="int64", is_primary=True, auto_id=True)
field2 = FieldSchema(name="embedding", dtype=DataType.FLOAT_VECTOR, description="float vector",
dim=VECTOR_DIMENSION, is_primary=False)
schema = CollectionSchema(fields=[field1, field2], description="collection description")
self.collection = Collection(name=collection_name, schema=schema)
LOGGER.debug(f"Create Milvus collection: {collection_name}")
return "OK"
except Exception as e:
LOGGER.error(f"Failed create collection in Milvus: {e}")
sys.exit(1)
def insert(self, collection_name, vectors):
# Batch insert vectors to milvus collection
try:
self.set_collection(collection_name)
data = [vectors]
mr = self.collection.insert(data)
ids = mr.primary_keys
LOGGER.debug(
f"Insert vectors to Milvus in collection: {collection_name} with {len(vectors)} rows")
return ids
except Exception as e:
LOGGER.error(f"Failed to insert data to Milvus: {e}")
sys.exit(1)
def create_index(self, collection_name):
# Create IVF_FLAT index on milvus collection
try:
self.set_collection(collection_name)
default_index = {"metric_type": METRIC_TYPE, "index_type": "IVF_FLAT", "params": {"nlist": 2048}}
status = self.collection.create_index(field_name="embedding", index_params=default_index)
if not status.code:
LOGGER.debug(
f"Successfully create index in collection:{collection_name} with param:{default_index}")
return status
else:
raise Exception(status.message)
except Exception as e:
LOGGER.error(f"Failed to create index: {e}")
sys.exit(1)
def delete_collection(self, collection_name):
# Delete Milvus collection
try:
self.set_collection(collection_name)
self.collection.drop()
LOGGER.debug("Successfully drop collection!")
return "ok"
except Exception as e:
LOGGER.error(f"Failed to drop collection: {e}")
sys.exit(1)
def search_vectors(self, collection_name, vectors, top_k):
# Search vector in milvus collection
try:
self.set_collection(collection_name)
self.collection.load()
search_params = {"metric_type": METRIC_TYPE, "params": {"nprobe": 16}}
res = self.collection.search(vectors, anns_field="embedding", param=search_params, limit=top_k)
LOGGER.debug(f"Successfully search in collection: {res}")
return res
except Exception as e:
LOGGER.error(f"Failed to search vectors in Milvus: {e}")
sys.exit(1)
def count(self, collection_name):
# Get the number of milvus collection
try:
self.set_collection(collection_name)
self.collection.flush()
num = self.collection.num_entities
LOGGER.debug(f"Successfully get the num:{num} of the collection:{collection_name}")
return num
except Exception as e:
LOGGER.error(f"Failed to count vectors in Milvus: {e}")
sys.exit(1)

101
server/src/mysql_helpers.py Normal file
View File

@ -0,0 +1,101 @@
import sys
import pymysql
from config import MYSQL_HOST, MYSQL_PORT, MYSQL_USER, MYSQL_PWD, MYSQL_DB
from logs import LOGGER
class MySQLHelper():
"""
Say something about the ExampleCalass...
Args:
args_0 (`type`):
...
"""
def __init__(self):
self.conn = pymysql.connect(host=MYSQL_HOST, user=MYSQL_USER, port=MYSQL_PORT, password=MYSQL_PWD,
database=MYSQL_DB,
local_infile=True)
self.cursor = self.conn.cursor()
def test_connection(self):
try:
self.conn.ping()
except Exception:
self.conn = pymysql.connect(host=MYSQL_HOST, user=MYSQL_USER, port=MYSQL_PORT, password=MYSQL_PWD,
database=MYSQL_DB,local_infile=True)
self.cursor = self.conn.cursor()
def create_mysql_table(self, table_name):
# Create mysql table if not exists
self.test_connection()
sql = "create table if not exists " + table_name + "(milvus_id TEXT, image_path TEXT);"
try:
self.cursor.execute(sql)
LOGGER.debug(f"MYSQL create table: {table_name} with sql: {sql}")
except Exception as e:
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
sys.exit(1)
def load_data_to_mysql(self, table_name, data):
# Batch insert (Milvus_ids, img_path) to mysql
self.test_connection()
sql = "insert into " + table_name + " (milvus_id,image_path) values (%s,%s);"
try:
self.cursor.executemany(sql, data)
self.conn.commit()
LOGGER.debug(f"MYSQL loads data to table: {table_name} successfully")
except Exception as e:
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
sys.exit(1)
def search_by_milvus_ids(self, ids, table_name):
# Get the img_path according to the milvus ids
self.test_connection()
str_ids = str(ids).replace('[', '').replace(']', '')
sql = "select image_path from " + table_name + " where milvus_id in (" + str_ids + ") order by field (milvus_id," + str_ids + ");"
try:
self.cursor.execute(sql)
results = self.cursor.fetchall()
results = [res[0] for res in results]
LOGGER.debug("MYSQL search by milvus id.")
return results
except Exception as e:
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
sys.exit(1)
def delete_table(self, table_name):
# Delete mysql table if exists
self.test_connection()
sql = "drop table if exists " + table_name + ";"
try:
self.cursor.execute(sql)
LOGGER.debug(f"MYSQL delete table:{table_name}")
except Exception as e:
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
sys.exit(1)
def delete_all_data(self, table_name):
# Delete all the data in mysql table
self.test_connection()
sql = 'delete from ' + table_name + ';'
try:
self.cursor.execute(sql)
self.conn.commit()
LOGGER.debug(f"MYSQL delete all data in table:{table_name}")
except Exception as e:
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
sys.exit(1)
def count_table(self, table_name):
# Get the number of mysql table
self.test_connection()
sql = "select count(milvus_id) from " + table_name + ";"
try:
self.cursor.execute(sql)
results = self.cursor.fetchall()
LOGGER.debug(f"MYSQL count table:{table_name}")
return results[0][0]
except Exception as e:
LOGGER.error(f"MYSQL ERROR: {e} with sql: {sql}")
sys.exit(1)

View File

View File

@ -0,0 +1,16 @@
import sys
from config import DEFAULT_TABLE
from logs import LOGGER
from milvus_helpers import MilvusHelper
def do_count(table_name: str, milvus_cli: MilvusHelper):
if not table_name:
table_name = DEFAULT_TABLE
try:
if not milvus_cli.has_collection(table_name):
return None
num = milvus_cli.count(table_name)
return num
except Exception as e:
LOGGER.error(f"Error with count table {e}")
sys.exit(1)

View File

@ -0,0 +1,19 @@
import sys
from config import DEFAULT_TABLE
from logs import LOGGER
from milvus_helpers import MilvusHelper
from mysql_helpers import MySQLHelper
def do_drop(table_name: str, milvus_cli: MilvusHelper, mysql_cli: MySQLHelper):
if not table_name:
table_name = DEFAULT_TABLE
try:
if not milvus_cli.has_collection(table_name):
return f"Milvus doesn't have a collection named {table_name}"
status = milvus_cli.delete_collection(table_name)
mysql_cli.delete_table(table_name)
return status
except Exception as e:
LOGGER.error(f"Error with drop table: {e}")
sys.exit(1)

View File

@ -0,0 +1,63 @@
import sys
import os
from diskcache import Cache
from config import DEFAULT_TABLE
from logs import LOGGER
from milvus_helpers import MilvusHelper
from mysql_helpers import MySQLHelper
from encode import Resnet50
# Get the path to the image
def get_imgs(path):
pics = []
for f in os.listdir(path):
if ((f.endswith(extension) for extension in
['.png', '.jpg', '.jpeg', '.PNG', '.JPG', '.JPEG']) and not f.startswith('.DS_Store')):
pics.append(os.path.join(path, f))
return pics
# Get the vector of images
def extract_features(img_dir, model):
try:
cache = Cache('./tmp')
feats = []
names = []
img_list = get_imgs(img_dir)
total = len(img_list)
cache['total'] = total
for i, img_path in enumerate(img_list):
try:
norm_feat = model.resnet50_extract_feat(img_path)
feats.append(norm_feat)
names.append(img_path.encode())
cache['current'] = i + 1
LOGGER.info(f"Extracting feature from image No. {i + 1} , {total} images in total")
except Exception as e:
LOGGER.error(f"Error with extracting feature from image {e}")
continue
return feats, names
except Exception as e:
LOGGER.error(f"Error with extracting feature from image {e}")
sys.exit(1)
# Combine the id of the vector and the name of the image into a list
def format_data(ids, names):
data = [(str(i), n) for i, n in zip(ids, names)]
return data
# Import vectors to Milvus and data to Mysql respectively
def do_load(table_name: str, image_dir: str, model: Resnet50, milvus_client: MilvusHelper, mysql_cli: MySQLHelper):
if not table_name:
table_name = DEFAULT_TABLE
if not milvus_client.has_collection(table_name):
milvus_client.create_collection(table_name)
milvus_client.create_index(table_name)
vectors, names = extract_features(image_dir, model)
ids = milvus_client.insert(table_name, vectors)
mysql_cli.create_mysql_table(table_name)
mysql_cli.load_data_to_mysql(table_name, format_data(ids, names))
return len(ids)

View File

@ -0,0 +1,21 @@
import sys
from config import DEFAULT_TABLE
from logs import LOGGER
from milvus_helpers import MilvusHelper
from mysql_helpers import MySQLHelper
from encode import Resnet50
def do_search(table_name: str, img_path: str, top_k: int, model: Resnet50, milvus_client: MilvusHelper, mysql_cli: MySQLHelper):
try:
if not table_name:
table_name = DEFAULT_TABLE
feat = model.resnet50_extract_feat(img_path)
vectors = milvus_client.search_vectors(table_name, [feat], top_k)
vids = [str(x.id) for x in vectors[0]]
paths = mysql_cli.search_by_milvus_ids(vids, table_name)
distances = [x.distance for x in vectors[0]]
return paths, distances
except Exception as e:
LOGGER.error(f"Error with search : {e}")
sys.exit(1)

View File

@ -0,0 +1,22 @@
import sys
from config import DEFAULT_TABLE
from logs import LOGGER
from milvus_helpers import MilvusHelper
from mysql_helpers import MySQLHelper
from encode import Resnet50
def do_upload(table_name: str, img_path: str, model: Resnet50, milvus_client: MilvusHelper, mysql_cli: MySQLHelper):
try:
if not table_name:
table_name = DEFAULT_TABLE
if not milvus_client.has_collection(table_name):
milvus_client.create_collection(table_name)
milvus_client.create_index(table_name)
feat = model.resnet50_extract_feat(img_path)
ids = milvus_client.insert(table_name, [feat])
mysql_cli.create_mysql_table(table_name)
mysql_cli.load_data_to_mysql(table_name, [(str(ids[0]), img_path.encode())])
return ids[0]
except Exception as e:
LOGGER.error(f"Error with upload : {e}")
sys.exit(1)

50
server/src/test_main.py Normal file
View File

@ -0,0 +1,50 @@
from fastapi.testclient import TestClient
import gdown
import zipfile
from main import app
client = TestClient(app)
def get_file():
url = 'https://drive.google.com/uc?id=1omhIvzbXM9t0mU3hDFqLDpbKpwqyW__b'
gdown.download(url)
with zipfile.ZipFile('example_img.zip', 'r') as zip_ref:
zip_ref.extractall('./')
def test_drop():
response = client.post('/img/drop')
assert response.status_code == 200
def test_load_img():
get_file()
response = client.post(
'/img/load',
json={"File": "./example_img"}
)
assert response.status_code == 200
def test_progress():
response = client.get('/progress')
assert response.status_code == 200
assert response.json() == "current: 20, total: 20"
def test_count():
response = client.post('/img/count')
assert response.status_code == 200
def test_get_img():
response = client.get('/data?image_path=.%2Fexample_img%2Ftest.jpg')
assert response.status_code == 200
def test_upload_img():
_test_upload_file = './example_img/test.jpg'
_files = {'image': open(_test_upload_file, 'rb')}
response = client.post('/img/upload', files = _files)
assert response.status_code == 200
def test_search():
_test_upload_file = './example_img/test.jpg'
_files = {'image': open(_test_upload_file, 'rb')}
response = client.post('/img/search', files = _files)
assert response.status_code == 200

58
test_docker_compose.py Normal file
View File

@ -0,0 +1,58 @@
import requests
import gdown
import zipfile
def get_file():
url = 'https://drive.google.com/uc?id=1omhIvzbXM9t0mU3hDFqLDpbKpwqyW__b'
gdown.download(url)
with zipfile.ZipFile('example_img.zip', 'r') as zip_ref:
zip_ref.extractall('./data')
def test_load():
get_file()
response = requests.post(
"http://127.0.0.1:5000/img/load",
json={"File": "/data/example_img"}
)
assert response.status_code == 200
assert response.json() == "Successfully loaded data!"
def test_progress():
response = requests.get("http://127.0.0.1:5000/progress")
assert response.status_code == 200
assert response.json() == "current: 20, total: 20"
def test_count():
response = requests.post("http://127.0.0.1:5000/img/count")
assert response.status_code == 200
assert response.json() == 20
def test_get_img():
response = requests.get(
'http://127.0.0.1:5000/data?image_path=%2Fdata%2Fexample_img%2Ftest.jpg'
)
assert response.status_code == 200
def test_upload_img():
_test_upload_file = './data/example_img/test.jpg'
_files = {'image': open(_test_upload_file, 'rb')}
response = requests.post(
'http://127.0.0.1:5000/img/upload',
files = _files
)
assert response.status_code == 200
def test_search():
_test_upload_file = './data/example_img/test.jpg'
_files = {'image': open(_test_upload_file, 'rb')}
response = requests.post(
'http://127.0.0.1:5000/img/search',
files = _files
)
assert response.status_code == 200
def test_drop():
response = requests.post("http://127.0.0.1:5000/img/drop")
assert response.status_code == 200

Binary file not shown.

Binary file not shown.

Binary file not shown.

Binary file not shown.

View File

@ -0,0 +1 @@
MANIFEST-000022

View File

@ -0,0 +1 @@
d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d

View File

395
volumes/milvus/rdb_data/LOG Normal file
View File

@ -0,0 +1,395 @@
2023/09/26-17:03:48.701850 14 RocksDB version: 6.27.3
2023/09/26-17:03:48.701866 14 Git sha 0
2023/09/26-17:03:48.701867 14 Compile date 2023-06-14 04:09:40
2023/09/26-17:03:48.701868 14 DB SUMMARY
2023/09/26-17:03:48.701868 14 DB Session ID: 345C9WGIGWXHNGD85BUN
2023/09/26-17:03:48.701885 14 CURRENT file: CURRENT
2023/09/26-17:03:48.701886 14 IDENTITY file: IDENTITY
2023/09/26-17:03:48.701890 14 MANIFEST file: MANIFEST-000016 size: 345 Bytes
2023/09/26-17:03:48.701892 14 SST files in /var/lib/milvus/rdb_data dir, Total Num: 2, files: 000009.sst 000015.sst
2023/09/26-17:03:48.701893 14 Write Ahead Log file in /var/lib/milvus/rdb_data: 000017.log size: 21716486 ;
2023/09/26-17:03:48.701894 14 Options.error_if_exists: 0
2023/09/26-17:03:48.701895 14 Options.create_if_missing: 1
2023/09/26-17:03:48.701895 14 Options.paranoid_checks: 1
2023/09/26-17:03:48.701896 14 Options.flush_verify_memtable_count: 1
2023/09/26-17:03:48.701897 14 Options.track_and_verify_wals_in_manifest: 0
2023/09/26-17:03:48.701897 14 Options.env: 0x5e1d140
2023/09/26-17:03:48.701898 14 Options.fs: PosixFileSystem
2023/09/26-17:03:48.701899 14 Options.info_log: 0x7f9d2084e370
2023/09/26-17:03:48.701900 14 Options.max_file_opening_threads: 16
2023/09/26-17:03:48.701900 14 Options.statistics: (nil)
2023/09/26-17:03:48.701901 14 Options.use_fsync: 0
2023/09/26-17:03:48.701902 14 Options.max_log_file_size: 0
2023/09/26-17:03:48.701903 14 Options.max_manifest_file_size: 1073741824
2023/09/26-17:03:48.701903 14 Options.log_file_time_to_roll: 0
2023/09/26-17:03:48.701904 14 Options.keep_log_file_num: 1000
2023/09/26-17:03:48.701905 14 Options.recycle_log_file_num: 0
2023/09/26-17:03:48.701905 14 Options.allow_fallocate: 1
2023/09/26-17:03:48.701906 14 Options.allow_mmap_reads: 0
2023/09/26-17:03:48.701907 14 Options.allow_mmap_writes: 0
2023/09/26-17:03:48.701907 14 Options.use_direct_reads: 0
2023/09/26-17:03:48.701908 14 Options.use_direct_io_for_flush_and_compaction: 0
2023/09/26-17:03:48.701909 14 Options.create_missing_column_families: 0
2023/09/26-17:03:48.701909 14 Options.db_log_dir:
2023/09/26-17:03:48.701910 14 Options.wal_dir:
2023/09/26-17:03:48.701911 14 Options.table_cache_numshardbits: 6
2023/09/26-17:03:48.701912 14 Options.WAL_ttl_seconds: 0
2023/09/26-17:03:48.701912 14 Options.WAL_size_limit_MB: 0
2023/09/26-17:03:48.701913 14 Options.max_write_batch_group_size_bytes: 1048576
2023/09/26-17:03:48.701914 14 Options.manifest_preallocation_size: 4194304
2023/09/26-17:03:48.701914 14 Options.is_fd_close_on_exec: 1
2023/09/26-17:03:48.701915 14 Options.advise_random_on_open: 1
2023/09/26-17:03:48.701916 14 Options.experimental_mempurge_threshold: 0.000000
2023/09/26-17:03:48.701917 14 Options.db_write_buffer_size: 0
2023/09/26-17:03:48.701918 14 Options.write_buffer_manager: 0x7f9d2080a280
2023/09/26-17:03:48.701919 14 Options.access_hint_on_compaction_start: 1
2023/09/26-17:03:48.701919 14 Options.new_table_reader_for_compaction_inputs: 0
2023/09/26-17:03:48.701920 14 Options.random_access_max_buffer_size: 1048576
2023/09/26-17:03:48.701921 14 Options.use_adaptive_mutex: 0
2023/09/26-17:03:48.701921 14 Options.rate_limiter: (nil)
2023/09/26-17:03:48.701922 14 Options.sst_file_manager.rate_bytes_per_sec: 0
2023/09/26-17:03:48.701923 14 Options.wal_recovery_mode: 2
2023/09/26-17:03:48.701927 14 Options.enable_thread_tracking: 0
2023/09/26-17:03:48.701927 14 Options.enable_pipelined_write: 0
2023/09/26-17:03:48.701928 14 Options.unordered_write: 0
2023/09/26-17:03:48.701929 14 Options.allow_concurrent_memtable_write: 1
2023/09/26-17:03:48.701929 14 Options.enable_write_thread_adaptive_yield: 1
2023/09/26-17:03:48.701930 14 Options.write_thread_max_yield_usec: 100
2023/09/26-17:03:48.701931 14 Options.write_thread_slow_yield_usec: 3
2023/09/26-17:03:48.701931 14 Options.row_cache: None
2023/09/26-17:03:48.701932 14 Options.wal_filter: None
2023/09/26-17:03:48.701933 14 Options.avoid_flush_during_recovery: 0
2023/09/26-17:03:48.701933 14 Options.allow_ingest_behind: 0
2023/09/26-17:03:48.701934 14 Options.preserve_deletes: 0
2023/09/26-17:03:48.701935 14 Options.two_write_queues: 0
2023/09/26-17:03:48.701935 14 Options.manual_wal_flush: 0
2023/09/26-17:03:48.701936 14 Options.atomic_flush: 0
2023/09/26-17:03:48.701937 14 Options.avoid_unnecessary_blocking_io: 0
2023/09/26-17:03:48.701937 14 Options.persist_stats_to_disk: 0
2023/09/26-17:03:48.701938 14 Options.write_dbid_to_manifest: 0
2023/09/26-17:03:48.701938 14 Options.log_readahead_size: 0
2023/09/26-17:03:48.701939 14 Options.file_checksum_gen_factory: Unknown
2023/09/26-17:03:48.701940 14 Options.best_efforts_recovery: 0
2023/09/26-17:03:48.701941 14 Options.max_bgerror_resume_count: 2147483647
2023/09/26-17:03:48.701942 14 Options.bgerror_resume_retry_interval: 1000000
2023/09/26-17:03:48.701942 14 Options.allow_data_in_errors: 0
2023/09/26-17:03:48.701943 14 Options.db_host_id: __hostname__
2023/09/26-17:03:48.701944 14 Options.max_background_jobs: 1
2023/09/26-17:03:48.701944 14 Options.max_background_compactions: -1
2023/09/26-17:03:48.701945 14 Options.max_subcompactions: 1
2023/09/26-17:03:48.701946 14 Options.avoid_flush_during_shutdown: 0
2023/09/26-17:03:48.701946 14 Options.writable_file_max_buffer_size: 1048576
2023/09/26-17:03:48.701947 14 Options.delayed_write_rate : 16777216
2023/09/26-17:03:48.701948 14 Options.max_total_wal_size: 0
2023/09/26-17:03:48.701948 14 Options.delete_obsolete_files_period_micros: 21600000000
2023/09/26-17:03:48.701949 14 Options.stats_dump_period_sec: 600
2023/09/26-17:03:48.701950 14 Options.stats_persist_period_sec: 600
2023/09/26-17:03:48.701950 14 Options.stats_history_buffer_size: 1048576
2023/09/26-17:03:48.701951 14 Options.max_open_files: -1
2023/09/26-17:03:48.701952 14 Options.bytes_per_sync: 0
2023/09/26-17:03:48.701952 14 Options.wal_bytes_per_sync: 0
2023/09/26-17:03:48.701953 14 Options.strict_bytes_per_sync: 0
2023/09/26-17:03:48.701954 14 Options.compaction_readahead_size: 0
2023/09/26-17:03:48.701954 14 Options.max_background_flushes: 1
2023/09/26-17:03:48.701955 14 Compression algorithms supported:
2023/09/26-17:03:48.701956 14 kZSTDNotFinalCompression supported: 1
2023/09/26-17:03:48.701957 14 kZSTD supported: 1
2023/09/26-17:03:48.701958 14 kXpressCompression supported: 0
2023/09/26-17:03:48.701958 14 kLZ4HCCompression supported: 0
2023/09/26-17:03:48.701959 14 kLZ4Compression supported: 0
2023/09/26-17:03:48.701960 14 kBZip2Compression supported: 0
2023/09/26-17:03:48.701960 14 kZlibCompression supported: 0
2023/09/26-17:03:48.701961 14 kSnappyCompression supported: 0
2023/09/26-17:03:48.701962 14 Fast CRC32 supported: Supported on x86
2023/09/26-17:03:48.702132 14 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data/MANIFEST-000016
2023/09/26-17:03:48.702202 14 [db/column_family.cc:605] --------------- Options for column family [default]:
2023/09/26-17:03:48.702204 14 Options.comparator: leveldb.BytewiseComparator
2023/09/26-17:03:48.702205 14 Options.merge_operator: None
2023/09/26-17:03:48.702205 14 Options.compaction_filter: None
2023/09/26-17:03:48.702206 14 Options.compaction_filter_factory: None
2023/09/26-17:03:48.702207 14 Options.sst_partitioner_factory: None
2023/09/26-17:03:48.702207 14 Options.memtable_factory: SkipListFactory
2023/09/26-17:03:48.702208 14 Options.table_factory: BlockBasedTable
2023/09/26-17:03:48.702222 14 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9d2089a560)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x7f9d2080a010
block_cache_name: LRUCache
block_cache_options:
capacity : 2502992855
num_shard_bits : 6
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.500
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 65536
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
2023/09/26-17:03:48.702223 14 Options.write_buffer_size: 67108864
2023/09/26-17:03:48.702224 14 Options.max_write_buffer_number: 2
2023/09/26-17:03:48.702225 14 Options.compression[0]: NoCompression
2023/09/26-17:03:48.702226 14 Options.compression[1]: ZSTD
2023/09/26-17:03:48.702226 14 Options.compression[2]: ZSTD
2023/09/26-17:03:48.702227 14 Options.bottommost_compression: Disabled
2023/09/26-17:03:48.702228 14 Options.prefix_extractor: nullptr
2023/09/26-17:03:48.702228 14 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023/09/26-17:03:48.702229 14 Options.num_levels: 7
2023/09/26-17:03:48.702230 14 Options.min_write_buffer_number_to_merge: 1
2023/09/26-17:03:48.702230 14 Options.max_write_buffer_number_to_maintain: 0
2023/09/26-17:03:48.702231 14 Options.max_write_buffer_size_to_maintain: 0
2023/09/26-17:03:48.702232 14 Options.bottommost_compression_opts.window_bits: -14
2023/09/26-17:03:48.702232 14 Options.bottommost_compression_opts.level: 32767
2023/09/26-17:03:48.702233 14 Options.bottommost_compression_opts.strategy: 0
2023/09/26-17:03:48.702234 14 Options.bottommost_compression_opts.max_dict_bytes: 0
2023/09/26-17:03:48.702234 14 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023/09/26-17:03:48.702235 14 Options.bottommost_compression_opts.parallel_threads: 1
2023/09/26-17:03:48.702236 14 Options.bottommost_compression_opts.enabled: false
2023/09/26-17:03:48.702236 14 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2023/09/26-17:03:48.702237 14 Options.compression_opts.window_bits: -14
2023/09/26-17:03:48.702238 14 Options.compression_opts.level: 32767
2023/09/26-17:03:48.702238 14 Options.compression_opts.strategy: 0
2023/09/26-17:03:48.702239 14 Options.compression_opts.max_dict_bytes: 0
2023/09/26-17:03:48.702240 14 Options.compression_opts.zstd_max_train_bytes: 0
2023/09/26-17:03:48.702240 14 Options.compression_opts.parallel_threads: 1
2023/09/26-17:03:48.702241 14 Options.compression_opts.enabled: false
2023/09/26-17:03:48.702242 14 Options.compression_opts.max_dict_buffer_bytes: 0
2023/09/26-17:03:48.702245 14 Options.level0_file_num_compaction_trigger: 4
2023/09/26-17:03:48.702246 14 Options.level0_slowdown_writes_trigger: 20
2023/09/26-17:03:48.702247 14 Options.level0_stop_writes_trigger: 36
2023/09/26-17:03:48.702247 14 Options.target_file_size_base: 67108864
2023/09/26-17:03:48.702248 14 Options.target_file_size_multiplier: 2
2023/09/26-17:03:48.702249 14 Options.max_bytes_for_level_base: 268435456
2023/09/26-17:03:48.702250 14 Options.level_compaction_dynamic_level_bytes: 0
2023/09/26-17:03:48.702250 14 Options.max_bytes_for_level_multiplier: 10.000000
2023/09/26-17:03:48.702251 14 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023/09/26-17:03:48.702252 14 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023/09/26-17:03:48.702253 14 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023/09/26-17:03:48.702254 14 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023/09/26-17:03:48.702254 14 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023/09/26-17:03:48.702255 14 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023/09/26-17:03:48.702256 14 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023/09/26-17:03:48.702256 14 Options.max_sequential_skip_in_iterations: 8
2023/09/26-17:03:48.702257 14 Options.max_compaction_bytes: 1677721600
2023/09/26-17:03:48.702258 14 Options.arena_block_size: 1048576
2023/09/26-17:03:48.702258 14 Options.soft_pending_compaction_bytes_limit: 68719476736
2023/09/26-17:03:48.702259 14 Options.hard_pending_compaction_bytes_limit: 274877906944
2023/09/26-17:03:48.702260 14 Options.rate_limit_delay_max_milliseconds: 100
2023/09/26-17:03:48.702260 14 Options.disable_auto_compactions: 0
2023/09/26-17:03:48.702261 14 Options.compaction_style: kCompactionStyleLevel
2023/09/26-17:03:48.702262 14 Options.compaction_pri: kMinOverlappingRatio
2023/09/26-17:03:48.702263 14 Options.compaction_options_universal.size_ratio: 1
2023/09/26-17:03:48.702264 14 Options.compaction_options_universal.min_merge_width: 2
2023/09/26-17:03:48.702264 14 Options.compaction_options_universal.max_merge_width: 4294967295
2023/09/26-17:03:48.702265 14 Options.compaction_options_universal.max_size_amplification_percent: 200
2023/09/26-17:03:48.702266 14 Options.compaction_options_universal.compression_size_percent: -1
2023/09/26-17:03:48.702266 14 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023/09/26-17:03:48.702267 14 Options.compaction_options_fifo.max_table_files_size: 1073741824
2023/09/26-17:03:48.702268 14 Options.compaction_options_fifo.allow_compaction: 0
2023/09/26-17:03:48.702271 14 Options.table_properties_collectors:
2023/09/26-17:03:48.702272 14 Options.inplace_update_support: 0
2023/09/26-17:03:48.702273 14 Options.inplace_update_num_locks: 10000
2023/09/26-17:03:48.702273 14 Options.memtable_prefix_bloom_size_ratio: 0.000000
2023/09/26-17:03:48.702274 14 Options.memtable_whole_key_filtering: 0
2023/09/26-17:03:48.702275 14 Options.memtable_huge_page_size: 0
2023/09/26-17:03:48.702276 14 Options.bloom_locality: 0
2023/09/26-17:03:48.702276 14 Options.max_successive_merges: 0
2023/09/26-17:03:48.702277 14 Options.optimize_filters_for_hits: 0
2023/09/26-17:03:48.702278 14 Options.paranoid_file_checks: 0
2023/09/26-17:03:48.702278 14 Options.force_consistency_checks: 1
2023/09/26-17:03:48.702279 14 Options.report_bg_io_stats: 0
2023/09/26-17:03:48.702279 14 Options.ttl: 2592000
2023/09/26-17:03:48.702280 14 Options.periodic_compaction_seconds: 0
2023/09/26-17:03:48.702281 14 Options.enable_blob_files: false
2023/09/26-17:03:48.702284 14 Options.min_blob_size: 0
2023/09/26-17:03:48.702284 14 Options.blob_file_size: 268435456
2023/09/26-17:03:48.702285 14 Options.blob_compression_type: NoCompression
2023/09/26-17:03:48.702286 14 Options.enable_blob_garbage_collection: false
2023/09/26-17:03:48.702286 14 Options.blob_garbage_collection_age_cutoff: 0.250000
2023/09/26-17:03:48.702287 14 Options.blob_garbage_collection_force_threshold: 1.000000
2023/09/26-17:03:48.702288 14 Options.blob_compaction_readahead_size: 0
2023/09/26-17:03:48.703175 14 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data/MANIFEST-000016 succeeded,manifest_file_number is 16, next_file_number is 18, last_sequence is 72527, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023/09/26-17:03:48.703178 14 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 12
2023/09/26-17:03:48.703355 14 [db/version_set.cc:4384] Creating manifest 20
2023/09/26-17:03:48.707321 14 EVENT_LOG_v1 {"time_micros": 1695747828707319, "job": 1, "event": "recovery_started", "wal_files": [17]}
2023/09/26-17:03:48.707324 14 [db/db_impl/db_impl_open.cc:883] Recovering log #17 mode 2
2023/09/26-17:03:48.779335 14 EVENT_LOG_v1 {"time_micros": 1695747828779316, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 21, "file_size": 19283516, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 19280595, "index_size": 1992, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 2492118, "raw_average_key_size": 51, "raw_value_size": 18544810, "raw_average_value_size": 384, "num_data_blocks": 35, "num_entries": 48227, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695747828, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d", "db_session_id": "345C9WGIGWXHNGD85BUN", "orig_file_number": 21}}
2023/09/26-17:03:48.779724 14 [db/version_set.cc:4384] Creating manifest 22
2023/09/26-17:03:48.783883 14 EVENT_LOG_v1 {"time_micros": 1695747828783880, "job": 1, "event": "recovery_finished"}
2023/09/26-17:03:48.788207 14 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data/000017.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
2023/09/26-17:03:48.788228 14 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9d20855380
2023/09/26-17:03:48.788248 14 DB pointer 0x7f9d2083ac00
2023/09/26-17:03:51.788542 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:03:51.788578 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3.1 total, 3.1 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3.1 total, 3.1 interval
Flush(GB): cumulative 0.018, interval 0.018
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.02 GB write, 5.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.02 GB write, 5.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 1 last_copies: 1 last_secs: 2.9e-05 secs_since: 3
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-17:13:51.788904 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:13:51.788979 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 603.1 total, 600.0 interval
Cumulative writes: 7052 writes, 7052 keys, 7052 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.03 MB/s
Cumulative WAL: 7052 writes, 0 syncs, 7052.00 writes per sync, written: 0.02 GB, 0.03 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7052 writes, 7052 keys, 7052 commit groups, 1.0 writes per commit group, ingest: 17.05 MB, 0.03 MB/s
Interval WAL: 7052 writes, 0 syncs, 7052.00 writes per sync, written: 0.02 GB, 0.03 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 603.1 total, 600.0 interval
Flush(GB): cumulative 0.018, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.02 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 2 last_copies: 1 last_secs: 9.2e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-17:23:51.789136 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:23:51.789167 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1203.1 total, 600.0 interval
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
Cumulative WAL: 14K writes, 0 syncs, 14252.00 writes per sync, written: 0.02 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1203.1 total, 600.0 interval
Flush(GB): cumulative 0.018, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.02 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 3 last_copies: 1 last_secs: 9e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-17:33:51.789461 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:33:51.789532 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1803.1 total, 600.0 interval
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
Cumulative WAL: 21K writes, 0 syncs, 21452.00 writes per sync, written: 0.02 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 54.20 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Sum 3/0 54.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 524.4 0.04 0.00 1 0.035 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1803.1 total, 600.0 interval
Flush(GB): cumulative 0.018, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.02 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 4 last_copies: 1 last_secs: 0.000227 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **

File diff suppressed because it is too large Load Diff

View File

@ -0,0 +1,815 @@
2023/09/26-09:25:26.699470 17 RocksDB version: 6.27.3
2023/09/26-09:25:26.699496 17 Git sha 0
2023/09/26-09:25:26.699497 17 Compile date 2023-06-14 04:09:40
2023/09/26-09:25:26.699500 17 DB SUMMARY
2023/09/26-09:25:26.699501 17 DB Session ID: 6O2QNLLK9Q04IJ9PYGWU
2023/09/26-09:25:26.699516 17 CURRENT file: CURRENT
2023/09/26-09:25:26.699518 17 IDENTITY file: IDENTITY
2023/09/26-09:25:26.699522 17 MANIFEST file: MANIFEST-000004 size: 57 Bytes
2023/09/26-09:25:26.699523 17 SST files in /var/lib/milvus/rdb_data dir, Total Num: 0, files:
2023/09/26-09:25:26.699525 17 Write Ahead Log file in /var/lib/milvus/rdb_data: 000005.log size: 11594 ;
2023/09/26-09:25:26.699526 17 Options.error_if_exists: 0
2023/09/26-09:25:26.699527 17 Options.create_if_missing: 1
2023/09/26-09:25:26.699529 17 Options.paranoid_checks: 1
2023/09/26-09:25:26.699530 17 Options.flush_verify_memtable_count: 1
2023/09/26-09:25:26.699531 17 Options.track_and_verify_wals_in_manifest: 0
2023/09/26-09:25:26.699532 17 Options.env: 0x5e1d140
2023/09/26-09:25:26.699533 17 Options.fs: PosixFileSystem
2023/09/26-09:25:26.699534 17 Options.info_log: 0x7f9133a1a3c0
2023/09/26-09:25:26.699535 17 Options.max_file_opening_threads: 16
2023/09/26-09:25:26.699536 17 Options.statistics: (nil)
2023/09/26-09:25:26.699538 17 Options.use_fsync: 0
2023/09/26-09:25:26.699539 17 Options.max_log_file_size: 0
2023/09/26-09:25:26.699540 17 Options.max_manifest_file_size: 1073741824
2023/09/26-09:25:26.699541 17 Options.log_file_time_to_roll: 0
2023/09/26-09:25:26.699542 17 Options.keep_log_file_num: 1000
2023/09/26-09:25:26.699543 17 Options.recycle_log_file_num: 0
2023/09/26-09:25:26.699544 17 Options.allow_fallocate: 1
2023/09/26-09:25:26.699545 17 Options.allow_mmap_reads: 0
2023/09/26-09:25:26.699546 17 Options.allow_mmap_writes: 0
2023/09/26-09:25:26.699547 17 Options.use_direct_reads: 0
2023/09/26-09:25:26.699548 17 Options.use_direct_io_for_flush_and_compaction: 0
2023/09/26-09:25:26.699550 17 Options.create_missing_column_families: 0
2023/09/26-09:25:26.699550 17 Options.db_log_dir:
2023/09/26-09:25:26.699552 17 Options.wal_dir:
2023/09/26-09:25:26.699553 17 Options.table_cache_numshardbits: 6
2023/09/26-09:25:26.699554 17 Options.WAL_ttl_seconds: 0
2023/09/26-09:25:26.699555 17 Options.WAL_size_limit_MB: 0
2023/09/26-09:25:26.699555 17 Options.max_write_batch_group_size_bytes: 1048576
2023/09/26-09:25:26.699557 17 Options.manifest_preallocation_size: 4194304
2023/09/26-09:25:26.699558 17 Options.is_fd_close_on_exec: 1
2023/09/26-09:25:26.699559 17 Options.advise_random_on_open: 1
2023/09/26-09:25:26.699560 17 Options.experimental_mempurge_threshold: 0.000000
2023/09/26-09:25:26.699562 17 Options.db_write_buffer_size: 0
2023/09/26-09:25:26.699563 17 Options.write_buffer_manager: 0x7f9133a25280
2023/09/26-09:25:26.699564 17 Options.access_hint_on_compaction_start: 1
2023/09/26-09:25:26.699565 17 Options.new_table_reader_for_compaction_inputs: 0
2023/09/26-09:25:26.699566 17 Options.random_access_max_buffer_size: 1048576
2023/09/26-09:25:26.699567 17 Options.use_adaptive_mutex: 0
2023/09/26-09:25:26.699568 17 Options.rate_limiter: (nil)
2023/09/26-09:25:26.699570 17 Options.sst_file_manager.rate_bytes_per_sec: 0
2023/09/26-09:25:26.699571 17 Options.wal_recovery_mode: 2
2023/09/26-09:25:26.699572 17 Options.enable_thread_tracking: 0
2023/09/26-09:25:26.699579 17 Options.enable_pipelined_write: 0
2023/09/26-09:25:26.699580 17 Options.unordered_write: 0
2023/09/26-09:25:26.699582 17 Options.allow_concurrent_memtable_write: 1
2023/09/26-09:25:26.699583 17 Options.enable_write_thread_adaptive_yield: 1
2023/09/26-09:25:26.699584 17 Options.write_thread_max_yield_usec: 100
2023/09/26-09:25:26.699585 17 Options.write_thread_slow_yield_usec: 3
2023/09/26-09:25:26.699586 17 Options.row_cache: None
2023/09/26-09:25:26.699587 17 Options.wal_filter: None
2023/09/26-09:25:26.699589 17 Options.avoid_flush_during_recovery: 0
2023/09/26-09:25:26.699590 17 Options.allow_ingest_behind: 0
2023/09/26-09:25:26.699591 17 Options.preserve_deletes: 0
2023/09/26-09:25:26.699592 17 Options.two_write_queues: 0
2023/09/26-09:25:26.699593 17 Options.manual_wal_flush: 0
2023/09/26-09:25:26.699594 17 Options.atomic_flush: 0
2023/09/26-09:25:26.699595 17 Options.avoid_unnecessary_blocking_io: 0
2023/09/26-09:25:26.699596 17 Options.persist_stats_to_disk: 0
2023/09/26-09:25:26.699597 17 Options.write_dbid_to_manifest: 0
2023/09/26-09:25:26.699598 17 Options.log_readahead_size: 0
2023/09/26-09:25:26.699599 17 Options.file_checksum_gen_factory: Unknown
2023/09/26-09:25:26.699600 17 Options.best_efforts_recovery: 0
2023/09/26-09:25:26.699601 17 Options.max_bgerror_resume_count: 2147483647
2023/09/26-09:25:26.699602 17 Options.bgerror_resume_retry_interval: 1000000
2023/09/26-09:25:26.699604 17 Options.allow_data_in_errors: 0
2023/09/26-09:25:26.699605 17 Options.db_host_id: __hostname__
2023/09/26-09:25:26.699606 17 Options.max_background_jobs: 1
2023/09/26-09:25:26.699607 17 Options.max_background_compactions: -1
2023/09/26-09:25:26.699608 17 Options.max_subcompactions: 1
2023/09/26-09:25:26.699609 17 Options.avoid_flush_during_shutdown: 0
2023/09/26-09:25:26.699610 17 Options.writable_file_max_buffer_size: 1048576
2023/09/26-09:25:26.699611 17 Options.delayed_write_rate : 16777216
2023/09/26-09:25:26.699612 17 Options.max_total_wal_size: 0
2023/09/26-09:25:26.699613 17 Options.delete_obsolete_files_period_micros: 21600000000
2023/09/26-09:25:26.699615 17 Options.stats_dump_period_sec: 600
2023/09/26-09:25:26.699616 17 Options.stats_persist_period_sec: 600
2023/09/26-09:25:26.699617 17 Options.stats_history_buffer_size: 1048576
2023/09/26-09:25:26.699618 17 Options.max_open_files: -1
2023/09/26-09:25:26.699619 17 Options.bytes_per_sync: 0
2023/09/26-09:25:26.699620 17 Options.wal_bytes_per_sync: 0
2023/09/26-09:25:26.699621 17 Options.strict_bytes_per_sync: 0
2023/09/26-09:25:26.699622 17 Options.compaction_readahead_size: 0
2023/09/26-09:25:26.699623 17 Options.max_background_flushes: 1
2023/09/26-09:25:26.699624 17 Compression algorithms supported:
2023/09/26-09:25:26.699626 17 kZSTDNotFinalCompression supported: 1
2023/09/26-09:25:26.699627 17 kZSTD supported: 1
2023/09/26-09:25:26.699628 17 kXpressCompression supported: 0
2023/09/26-09:25:26.699629 17 kLZ4HCCompression supported: 0
2023/09/26-09:25:26.699630 17 kLZ4Compression supported: 0
2023/09/26-09:25:26.699631 17 kBZip2Compression supported: 0
2023/09/26-09:25:26.699632 17 kZlibCompression supported: 0
2023/09/26-09:25:26.699634 17 kSnappyCompression supported: 0
2023/09/26-09:25:26.699635 17 Fast CRC32 supported: Supported on x86
2023/09/26-09:25:26.699679 17 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data/MANIFEST-000004
2023/09/26-09:25:26.699782 17 [db/column_family.cc:605] --------------- Options for column family [default]:
2023/09/26-09:25:26.699789 17 Options.comparator: leveldb.BytewiseComparator
2023/09/26-09:25:26.699791 17 Options.merge_operator: None
2023/09/26-09:25:26.699792 17 Options.compaction_filter: None
2023/09/26-09:25:26.699793 17 Options.compaction_filter_factory: None
2023/09/26-09:25:26.699795 17 Options.sst_partitioner_factory: None
2023/09/26-09:25:26.699796 17 Options.memtable_factory: SkipListFactory
2023/09/26-09:25:26.699797 17 Options.table_factory: BlockBasedTable
2023/09/26-09:25:26.699820 17 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9133a146c0)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x7f9133a25010
block_cache_name: LRUCache
block_cache_options:
capacity : 2502992855
num_shard_bits : 6
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.500
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 65536
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
2023/09/26-09:25:26.699824 17 Options.write_buffer_size: 67108864
2023/09/26-09:25:26.699825 17 Options.max_write_buffer_number: 2
2023/09/26-09:25:26.699827 17 Options.compression[0]: NoCompression
2023/09/26-09:25:26.699829 17 Options.compression[1]: ZSTD
2023/09/26-09:25:26.699831 17 Options.compression[2]: ZSTD
2023/09/26-09:25:26.699832 17 Options.bottommost_compression: Disabled
2023/09/26-09:25:26.699833 17 Options.prefix_extractor: nullptr
2023/09/26-09:25:26.699835 17 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023/09/26-09:25:26.699836 17 Options.num_levels: 7
2023/09/26-09:25:26.699837 17 Options.min_write_buffer_number_to_merge: 1
2023/09/26-09:25:26.699838 17 Options.max_write_buffer_number_to_maintain: 0
2023/09/26-09:25:26.699840 17 Options.max_write_buffer_size_to_maintain: 0
2023/09/26-09:25:26.699841 17 Options.bottommost_compression_opts.window_bits: -14
2023/09/26-09:25:26.699843 17 Options.bottommost_compression_opts.level: 32767
2023/09/26-09:25:26.699844 17 Options.bottommost_compression_opts.strategy: 0
2023/09/26-09:25:26.699846 17 Options.bottommost_compression_opts.max_dict_bytes: 0
2023/09/26-09:25:26.699847 17 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023/09/26-09:25:26.699848 17 Options.bottommost_compression_opts.parallel_threads: 1
2023/09/26-09:25:26.699850 17 Options.bottommost_compression_opts.enabled: false
2023/09/26-09:25:26.699851 17 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2023/09/26-09:25:26.699852 17 Options.compression_opts.window_bits: -14
2023/09/26-09:25:26.699853 17 Options.compression_opts.level: 32767
2023/09/26-09:25:26.699855 17 Options.compression_opts.strategy: 0
2023/09/26-09:25:26.699856 17 Options.compression_opts.max_dict_bytes: 0
2023/09/26-09:25:26.699857 17 Options.compression_opts.zstd_max_train_bytes: 0
2023/09/26-09:25:26.699858 17 Options.compression_opts.parallel_threads: 1
2023/09/26-09:25:26.699859 17 Options.compression_opts.enabled: false
2023/09/26-09:25:26.699861 17 Options.compression_opts.max_dict_buffer_bytes: 0
2023/09/26-09:25:26.699866 17 Options.level0_file_num_compaction_trigger: 4
2023/09/26-09:25:26.699867 17 Options.level0_slowdown_writes_trigger: 20
2023/09/26-09:25:26.699868 17 Options.level0_stop_writes_trigger: 36
2023/09/26-09:25:26.699870 17 Options.target_file_size_base: 67108864
2023/09/26-09:25:26.699871 17 Options.target_file_size_multiplier: 2
2023/09/26-09:25:26.699872 17 Options.max_bytes_for_level_base: 268435456
2023/09/26-09:25:26.699873 17 Options.level_compaction_dynamic_level_bytes: 0
2023/09/26-09:25:26.699874 17 Options.max_bytes_for_level_multiplier: 10.000000
2023/09/26-09:25:26.699876 17 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023/09/26-09:25:26.699878 17 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023/09/26-09:25:26.699879 17 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023/09/26-09:25:26.699881 17 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023/09/26-09:25:26.699882 17 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023/09/26-09:25:26.699883 17 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023/09/26-09:25:26.699884 17 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023/09/26-09:25:26.699886 17 Options.max_sequential_skip_in_iterations: 8
2023/09/26-09:25:26.699887 17 Options.max_compaction_bytes: 1677721600
2023/09/26-09:25:26.699888 17 Options.arena_block_size: 1048576
2023/09/26-09:25:26.699889 17 Options.soft_pending_compaction_bytes_limit: 68719476736
2023/09/26-09:25:26.699891 17 Options.hard_pending_compaction_bytes_limit: 274877906944
2023/09/26-09:25:26.699892 17 Options.rate_limit_delay_max_milliseconds: 100
2023/09/26-09:25:26.699893 17 Options.disable_auto_compactions: 0
2023/09/26-09:25:26.699895 17 Options.compaction_style: kCompactionStyleLevel
2023/09/26-09:25:26.699897 17 Options.compaction_pri: kMinOverlappingRatio
2023/09/26-09:25:26.699898 17 Options.compaction_options_universal.size_ratio: 1
2023/09/26-09:25:26.699899 17 Options.compaction_options_universal.min_merge_width: 2
2023/09/26-09:25:26.699900 17 Options.compaction_options_universal.max_merge_width: 4294967295
2023/09/26-09:25:26.699901 17 Options.compaction_options_universal.max_size_amplification_percent: 200
2023/09/26-09:25:26.699902 17 Options.compaction_options_universal.compression_size_percent: -1
2023/09/26-09:25:26.699904 17 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023/09/26-09:25:26.699905 17 Options.compaction_options_fifo.max_table_files_size: 1073741824
2023/09/26-09:25:26.699906 17 Options.compaction_options_fifo.allow_compaction: 0
2023/09/26-09:25:26.699910 17 Options.table_properties_collectors:
2023/09/26-09:25:26.699911 17 Options.inplace_update_support: 0
2023/09/26-09:25:26.699912 17 Options.inplace_update_num_locks: 10000
2023/09/26-09:25:26.699913 17 Options.memtable_prefix_bloom_size_ratio: 0.000000
2023/09/26-09:25:26.699915 17 Options.memtable_whole_key_filtering: 0
2023/09/26-09:25:26.699916 17 Options.memtable_huge_page_size: 0
2023/09/26-09:25:26.699917 17 Options.bloom_locality: 0
2023/09/26-09:25:26.699918 17 Options.max_successive_merges: 0
2023/09/26-09:25:26.699919 17 Options.optimize_filters_for_hits: 0
2023/09/26-09:25:26.699920 17 Options.paranoid_file_checks: 0
2023/09/26-09:25:26.699922 17 Options.force_consistency_checks: 1
2023/09/26-09:25:26.699923 17 Options.report_bg_io_stats: 0
2023/09/26-09:25:26.699924 17 Options.ttl: 2592000
2023/09/26-09:25:26.699925 17 Options.periodic_compaction_seconds: 0
2023/09/26-09:25:26.699926 17 Options.enable_blob_files: false
2023/09/26-09:25:26.699927 17 Options.min_blob_size: 0
2023/09/26-09:25:26.699932 17 Options.blob_file_size: 268435456
2023/09/26-09:25:26.699933 17 Options.blob_compression_type: NoCompression
2023/09/26-09:25:26.699934 17 Options.enable_blob_garbage_collection: false
2023/09/26-09:25:26.699935 17 Options.blob_garbage_collection_age_cutoff: 0.250000
2023/09/26-09:25:26.699937 17 Options.blob_garbage_collection_force_threshold: 1.000000
2023/09/26-09:25:26.699939 17 Options.blob_compaction_readahead_size: 0
2023/09/26-09:25:26.700713 17 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data/MANIFEST-000004 succeeded,manifest_file_number is 4, next_file_number is 6, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023/09/26-09:25:26.700718 17 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 0
2023/09/26-09:25:26.700760 17 [db/version_set.cc:4384] Creating manifest 8
2023/09/26-09:25:26.704699 17 EVENT_LOG_v1 {"time_micros": 1695720326704696, "job": 1, "event": "recovery_started", "wal_files": [5]}
2023/09/26-09:25:26.704702 17 [db/db_impl/db_impl_open.cc:883] Recovering log #5 mode 2
2023/09/26-09:25:26.706160 17 EVENT_LOG_v1 {"time_micros": 1695720326706147, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 9, "file_size": 6408, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 5431, "index_size": 59, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 6396, "raw_average_key_size": 51, "raw_value_size": 3461, "raw_average_value_size": 27, "num_data_blocks": 1, "num_entries": 124, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695720326, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d", "db_session_id": "6O2QNLLK9Q04IJ9PYGWU", "orig_file_number": 9}}
2023/09/26-09:25:26.706181 17 [db/version_set.cc:4384] Creating manifest 10
2023/09/26-09:25:26.710205 17 EVENT_LOG_v1 {"time_micros": 1695720326710202, "job": 1, "event": "recovery_finished"}
2023/09/26-09:25:26.713610 17 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data/000005.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
2023/09/26-09:25:26.713628 17 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9133a5b380
2023/09/26-09:25:26.713653 17 DB pointer 0x7f9133a47c00
2023/09/26-09:25:29.713819 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:25:29.713835 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3.0 total, 3.0 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3.0 total, 3.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 1 last_copies: 1 last_secs: 3.4e-05 secs_since: 3
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-09:35:29.714154 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:35:29.714224 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 603.0 total, 600.0 interval
Cumulative writes: 4281 writes, 4281 keys, 4280 commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.06 MB/s
Cumulative WAL: 4281 writes, 0 syncs, 4281.00 writes per sync, written: 0.03 GB, 0.06 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 4281 writes, 4281 keys, 4280 commit groups, 1.0 writes per commit group, ingest: 33.28 MB, 0.06 MB/s
Interval WAL: 4281 writes, 0 syncs, 4281.00 writes per sync, written: 0.03 GB, 0.06 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 603.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 2 last_copies: 1 last_secs: 4.2e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-09:45:29.714631 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:45:29.714730 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1203.0 total, 600.0 interval
Cumulative writes: 11K writes, 11K keys, 11K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.03 MB/s
Cumulative WAL: 11K writes, 0 syncs, 11476.00 writes per sync, written: 0.03 GB, 0.03 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7195 writes, 7195 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7195 writes, 0 syncs, 7195.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1203.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 3 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-09:55:29.714886 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:55:29.714915 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1803.0 total, 600.0 interval
Cumulative writes: 18K writes, 18K keys, 18K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.02 MB/s
Cumulative WAL: 18K writes, 0 syncs, 18674.00 writes per sync, written: 0.03 GB, 0.02 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7198 writes, 7198 keys, 7196 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1803.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 4 last_copies: 1 last_secs: 3.5e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:05:29.715058 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:05:29.715081 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 2403.0 total, 600.0 interval
Cumulative writes: 25K writes, 25K keys, 25K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.01 MB/s
Cumulative WAL: 25K writes, 0 syncs, 25870.00 writes per sync, written: 0.03 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7196 writes, 7196 keys, 7196 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7196 writes, 0 syncs, 7196.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 2403.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 5 last_copies: 1 last_secs: 3.4e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:15:29.715395 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:15:29.715471 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3003.0 total, 600.0 interval
Cumulative writes: 33K writes, 33K keys, 33K commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.01 MB/s
Cumulative WAL: 33K writes, 0 syncs, 33069.00 writes per sync, written: 0.03 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7199 writes, 7199 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3003.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 6 last_copies: 1 last_secs: 9.2e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:25:29.715681 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:25:29.715727 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3603.0 total, 600.0 interval
Cumulative writes: 40K writes, 40K keys, 40K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
Cumulative WAL: 40K writes, 0 syncs, 40269.00 writes per sync, written: 0.04 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7197 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3603.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 7 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:35:29.716030 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:35:29.716104 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 4203.0 total, 600.0 interval
Cumulative writes: 47K writes, 47K keys, 47K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
Cumulative WAL: 47K writes, 0 syncs, 47468.00 writes per sync, written: 0.04 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7199 writes, 7199 keys, 7197 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 4203.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 8 last_copies: 1 last_secs: 8.9e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:45:29.716385 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:45:29.716449 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 4803.0 total, 600.0 interval
Cumulative writes: 54K writes, 54K keys, 54K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
Cumulative WAL: 54K writes, 0 syncs, 54666.00 writes per sync, written: 0.04 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7198 writes, 7198 keys, 7194 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 4803.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 9 last_copies: 1 last_secs: 9e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:55:29.716744 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:55:29.716813 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 5403.0 total, 600.0 interval
Cumulative writes: 61K writes, 61K keys, 61K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
Cumulative WAL: 61K writes, 0 syncs, 61866.00 writes per sync, written: 0.04 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 5403.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 10 last_copies: 1 last_secs: 4.3e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:05:29.716970 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:05:29.717010 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 6003.0 total, 600.0 interval
Cumulative writes: 69K writes, 69K keys, 69K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
Cumulative WAL: 69K writes, 0 syncs, 69066.00 writes per sync, written: 0.04 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7197 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 6003.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 11 last_copies: 1 last_secs: 8.9e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:15:29.717259 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:15:29.717315 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 6603.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 3337 writes, 3337 keys, 3336 commit groups, 1.0 writes per commit group, ingest: 0.27 MB, 0.00 MB/s
Interval WAL: 3337 writes, 0 syncs, 3337.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 6603.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 12 last_copies: 1 last_secs: 3.6e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:25:29.717620 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:25:29.717693 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 7203.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 7203.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 13 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:35:29.717997 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:35:29.718068 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 7803.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.00 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 7803.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 14 last_copies: 1 last_secs: 7.7e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:45:29.718233 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:45:29.718281 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 8403.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.00 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72403.00 writes per sync, written: 0.04 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 6.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Sum 1/0 6.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.001 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 8403.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 15 last_copies: 1 last_secs: 9.6e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:54:32.182329 7 [db/db_impl/db_impl.cc:472] Shutdown: canceling all background work
2023/09/26-11:54:32.182528 7 [db/db_impl/db_impl.cc:685] Shutdown complete

View File

@ -0,0 +1,509 @@
2023/09/26-11:55:44.081185 16 RocksDB version: 6.27.3
2023/09/26-11:55:44.081207 16 Git sha 0
2023/09/26-11:55:44.081211 16 Compile date 2023-06-14 04:09:40
2023/09/26-11:55:44.081212 16 DB SUMMARY
2023/09/26-11:55:44.081214 16 DB Session ID: LDJPBRCKW95VBBDOA0BD
2023/09/26-11:55:44.081238 16 CURRENT file: CURRENT
2023/09/26-11:55:44.081240 16 IDENTITY file: IDENTITY
2023/09/26-11:55:44.081245 16 MANIFEST file: MANIFEST-000010 size: 199 Bytes
2023/09/26-11:55:44.081247 16 SST files in /var/lib/milvus/rdb_data dir, Total Num: 1, files: 000009.sst
2023/09/26-11:55:44.081248 16 Write Ahead Log file in /var/lib/milvus/rdb_data: 000011.log size: 41195590 ;
2023/09/26-11:55:44.081250 16 Options.error_if_exists: 0
2023/09/26-11:55:44.081252 16 Options.create_if_missing: 1
2023/09/26-11:55:44.081253 16 Options.paranoid_checks: 1
2023/09/26-11:55:44.081254 16 Options.flush_verify_memtable_count: 1
2023/09/26-11:55:44.081255 16 Options.track_and_verify_wals_in_manifest: 0
2023/09/26-11:55:44.081257 16 Options.env: 0x5e1d140
2023/09/26-11:55:44.081258 16 Options.fs: PosixFileSystem
2023/09/26-11:55:44.081259 16 Options.info_log: 0x7f9f31e4e370
2023/09/26-11:55:44.081261 16 Options.max_file_opening_threads: 16
2023/09/26-11:55:44.081262 16 Options.statistics: (nil)
2023/09/26-11:55:44.081264 16 Options.use_fsync: 0
2023/09/26-11:55:44.081265 16 Options.max_log_file_size: 0
2023/09/26-11:55:44.081266 16 Options.max_manifest_file_size: 1073741824
2023/09/26-11:55:44.081267 16 Options.log_file_time_to_roll: 0
2023/09/26-11:55:44.081269 16 Options.keep_log_file_num: 1000
2023/09/26-11:55:44.081270 16 Options.recycle_log_file_num: 0
2023/09/26-11:55:44.081271 16 Options.allow_fallocate: 1
2023/09/26-11:55:44.081272 16 Options.allow_mmap_reads: 0
2023/09/26-11:55:44.081273 16 Options.allow_mmap_writes: 0
2023/09/26-11:55:44.081274 16 Options.use_direct_reads: 0
2023/09/26-11:55:44.081276 16 Options.use_direct_io_for_flush_and_compaction: 0
2023/09/26-11:55:44.081277 16 Options.create_missing_column_families: 0
2023/09/26-11:55:44.081278 16 Options.db_log_dir:
2023/09/26-11:55:44.081279 16 Options.wal_dir:
2023/09/26-11:55:44.081281 16 Options.table_cache_numshardbits: 6
2023/09/26-11:55:44.081282 16 Options.WAL_ttl_seconds: 0
2023/09/26-11:55:44.081283 16 Options.WAL_size_limit_MB: 0
2023/09/26-11:55:44.081284 16 Options.max_write_batch_group_size_bytes: 1048576
2023/09/26-11:55:44.081285 16 Options.manifest_preallocation_size: 4194304
2023/09/26-11:55:44.081286 16 Options.is_fd_close_on_exec: 1
2023/09/26-11:55:44.081288 16 Options.advise_random_on_open: 1
2023/09/26-11:55:44.081289 16 Options.experimental_mempurge_threshold: 0.000000
2023/09/26-11:55:44.081291 16 Options.db_write_buffer_size: 0
2023/09/26-11:55:44.081293 16 Options.write_buffer_manager: 0x7f9f31e0a280
2023/09/26-11:55:44.081294 16 Options.access_hint_on_compaction_start: 1
2023/09/26-11:55:44.081295 16 Options.new_table_reader_for_compaction_inputs: 0
2023/09/26-11:55:44.081296 16 Options.random_access_max_buffer_size: 1048576
2023/09/26-11:55:44.081298 16 Options.use_adaptive_mutex: 0
2023/09/26-11:55:44.081299 16 Options.rate_limiter: (nil)
2023/09/26-11:55:44.081300 16 Options.sst_file_manager.rate_bytes_per_sec: 0
2023/09/26-11:55:44.081302 16 Options.wal_recovery_mode: 2
2023/09/26-11:55:44.081308 16 Options.enable_thread_tracking: 0
2023/09/26-11:55:44.081309 16 Options.enable_pipelined_write: 0
2023/09/26-11:55:44.081311 16 Options.unordered_write: 0
2023/09/26-11:55:44.081312 16 Options.allow_concurrent_memtable_write: 1
2023/09/26-11:55:44.081313 16 Options.enable_write_thread_adaptive_yield: 1
2023/09/26-11:55:44.081314 16 Options.write_thread_max_yield_usec: 100
2023/09/26-11:55:44.081316 16 Options.write_thread_slow_yield_usec: 3
2023/09/26-11:55:44.081317 16 Options.row_cache: None
2023/09/26-11:55:44.081318 16 Options.wal_filter: None
2023/09/26-11:55:44.081320 16 Options.avoid_flush_during_recovery: 0
2023/09/26-11:55:44.081321 16 Options.allow_ingest_behind: 0
2023/09/26-11:55:44.081322 16 Options.preserve_deletes: 0
2023/09/26-11:55:44.081323 16 Options.two_write_queues: 0
2023/09/26-11:55:44.081324 16 Options.manual_wal_flush: 0
2023/09/26-11:55:44.081326 16 Options.atomic_flush: 0
2023/09/26-11:55:44.081327 16 Options.avoid_unnecessary_blocking_io: 0
2023/09/26-11:55:44.081328 16 Options.persist_stats_to_disk: 0
2023/09/26-11:55:44.081329 16 Options.write_dbid_to_manifest: 0
2023/09/26-11:55:44.081330 16 Options.log_readahead_size: 0
2023/09/26-11:55:44.081332 16 Options.file_checksum_gen_factory: Unknown
2023/09/26-11:55:44.081333 16 Options.best_efforts_recovery: 0
2023/09/26-11:55:44.081334 16 Options.max_bgerror_resume_count: 2147483647
2023/09/26-11:55:44.081335 16 Options.bgerror_resume_retry_interval: 1000000
2023/09/26-11:55:44.081337 16 Options.allow_data_in_errors: 0
2023/09/26-11:55:44.081338 16 Options.db_host_id: __hostname__
2023/09/26-11:55:44.081340 16 Options.max_background_jobs: 1
2023/09/26-11:55:44.081341 16 Options.max_background_compactions: -1
2023/09/26-11:55:44.081342 16 Options.max_subcompactions: 1
2023/09/26-11:55:44.081344 16 Options.avoid_flush_during_shutdown: 0
2023/09/26-11:55:44.081345 16 Options.writable_file_max_buffer_size: 1048576
2023/09/26-11:55:44.081346 16 Options.delayed_write_rate : 16777216
2023/09/26-11:55:44.081348 16 Options.max_total_wal_size: 0
2023/09/26-11:55:44.081349 16 Options.delete_obsolete_files_period_micros: 21600000000
2023/09/26-11:55:44.081350 16 Options.stats_dump_period_sec: 600
2023/09/26-11:55:44.081352 16 Options.stats_persist_period_sec: 600
2023/09/26-11:55:44.081353 16 Options.stats_history_buffer_size: 1048576
2023/09/26-11:55:44.081354 16 Options.max_open_files: -1
2023/09/26-11:55:44.081356 16 Options.bytes_per_sync: 0
2023/09/26-11:55:44.081357 16 Options.wal_bytes_per_sync: 0
2023/09/26-11:55:44.081358 16 Options.strict_bytes_per_sync: 0
2023/09/26-11:55:44.081360 16 Options.compaction_readahead_size: 0
2023/09/26-11:55:44.081361 16 Options.max_background_flushes: 1
2023/09/26-11:55:44.081362 16 Compression algorithms supported:
2023/09/26-11:55:44.081364 16 kZSTDNotFinalCompression supported: 1
2023/09/26-11:55:44.081366 16 kZSTD supported: 1
2023/09/26-11:55:44.081367 16 kXpressCompression supported: 0
2023/09/26-11:55:44.081369 16 kLZ4HCCompression supported: 0
2023/09/26-11:55:44.081370 16 kLZ4Compression supported: 0
2023/09/26-11:55:44.081372 16 kBZip2Compression supported: 0
2023/09/26-11:55:44.081373 16 kZlibCompression supported: 0
2023/09/26-11:55:44.081375 16 kSnappyCompression supported: 0
2023/09/26-11:55:44.081377 16 Fast CRC32 supported: Supported on x86
2023/09/26-11:55:44.081417 16 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data/MANIFEST-000010
2023/09/26-11:55:44.081519 16 [db/column_family.cc:605] --------------- Options for column family [default]:
2023/09/26-11:55:44.081521 16 Options.comparator: leveldb.BytewiseComparator
2023/09/26-11:55:44.081522 16 Options.merge_operator: None
2023/09/26-11:55:44.081524 16 Options.compaction_filter: None
2023/09/26-11:55:44.081525 16 Options.compaction_filter_factory: None
2023/09/26-11:55:44.081526 16 Options.sst_partitioner_factory: None
2023/09/26-11:55:44.081528 16 Options.memtable_factory: SkipListFactory
2023/09/26-11:55:44.081529 16 Options.table_factory: BlockBasedTable
2023/09/26-11:55:44.081553 16 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9f31e00680)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x7f9f31e0a010
block_cache_name: LRUCache
block_cache_options:
capacity : 2502992855
num_shard_bits : 6
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.500
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 65536
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
2023/09/26-11:55:44.081555 16 Options.write_buffer_size: 67108864
2023/09/26-11:55:44.081556 16 Options.max_write_buffer_number: 2
2023/09/26-11:55:44.081558 16 Options.compression[0]: NoCompression
2023/09/26-11:55:44.081559 16 Options.compression[1]: ZSTD
2023/09/26-11:55:44.081561 16 Options.compression[2]: ZSTD
2023/09/26-11:55:44.081562 16 Options.bottommost_compression: Disabled
2023/09/26-11:55:44.081563 16 Options.prefix_extractor: nullptr
2023/09/26-11:55:44.081565 16 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023/09/26-11:55:44.081566 16 Options.num_levels: 7
2023/09/26-11:55:44.081567 16 Options.min_write_buffer_number_to_merge: 1
2023/09/26-11:55:44.081569 16 Options.max_write_buffer_number_to_maintain: 0
2023/09/26-11:55:44.081570 16 Options.max_write_buffer_size_to_maintain: 0
2023/09/26-11:55:44.081571 16 Options.bottommost_compression_opts.window_bits: -14
2023/09/26-11:55:44.081573 16 Options.bottommost_compression_opts.level: 32767
2023/09/26-11:55:44.081574 16 Options.bottommost_compression_opts.strategy: 0
2023/09/26-11:55:44.081575 16 Options.bottommost_compression_opts.max_dict_bytes: 0
2023/09/26-11:55:44.081577 16 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023/09/26-11:55:44.081578 16 Options.bottommost_compression_opts.parallel_threads: 1
2023/09/26-11:55:44.081579 16 Options.bottommost_compression_opts.enabled: false
2023/09/26-11:55:44.081581 16 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2023/09/26-11:55:44.081582 16 Options.compression_opts.window_bits: -14
2023/09/26-11:55:44.081583 16 Options.compression_opts.level: 32767
2023/09/26-11:55:44.081585 16 Options.compression_opts.strategy: 0
2023/09/26-11:55:44.081586 16 Options.compression_opts.max_dict_bytes: 0
2023/09/26-11:55:44.081587 16 Options.compression_opts.zstd_max_train_bytes: 0
2023/09/26-11:55:44.081589 16 Options.compression_opts.parallel_threads: 1
2023/09/26-11:55:44.081590 16 Options.compression_opts.enabled: false
2023/09/26-11:55:44.081591 16 Options.compression_opts.max_dict_buffer_bytes: 0
2023/09/26-11:55:44.081597 16 Options.level0_file_num_compaction_trigger: 4
2023/09/26-11:55:44.081598 16 Options.level0_slowdown_writes_trigger: 20
2023/09/26-11:55:44.081600 16 Options.level0_stop_writes_trigger: 36
2023/09/26-11:55:44.081601 16 Options.target_file_size_base: 67108864
2023/09/26-11:55:44.081602 16 Options.target_file_size_multiplier: 2
2023/09/26-11:55:44.081604 16 Options.max_bytes_for_level_base: 268435456
2023/09/26-11:55:44.081605 16 Options.level_compaction_dynamic_level_bytes: 0
2023/09/26-11:55:44.081606 16 Options.max_bytes_for_level_multiplier: 10.000000
2023/09/26-11:55:44.081608 16 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023/09/26-11:55:44.081610 16 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023/09/26-11:55:44.081611 16 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023/09/26-11:55:44.081613 16 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023/09/26-11:55:44.081614 16 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023/09/26-11:55:44.081615 16 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023/09/26-11:55:44.081617 16 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023/09/26-11:55:44.081618 16 Options.max_sequential_skip_in_iterations: 8
2023/09/26-11:55:44.081619 16 Options.max_compaction_bytes: 1677721600
2023/09/26-11:55:44.081621 16 Options.arena_block_size: 1048576
2023/09/26-11:55:44.081622 16 Options.soft_pending_compaction_bytes_limit: 68719476736
2023/09/26-11:55:44.081623 16 Options.hard_pending_compaction_bytes_limit: 274877906944
2023/09/26-11:55:44.081625 16 Options.rate_limit_delay_max_milliseconds: 100
2023/09/26-11:55:44.081626 16 Options.disable_auto_compactions: 0
2023/09/26-11:55:44.081628 16 Options.compaction_style: kCompactionStyleLevel
2023/09/26-11:55:44.081629 16 Options.compaction_pri: kMinOverlappingRatio
2023/09/26-11:55:44.081631 16 Options.compaction_options_universal.size_ratio: 1
2023/09/26-11:55:44.081632 16 Options.compaction_options_universal.min_merge_width: 2
2023/09/26-11:55:44.081633 16 Options.compaction_options_universal.max_merge_width: 4294967295
2023/09/26-11:55:44.081634 16 Options.compaction_options_universal.max_size_amplification_percent: 200
2023/09/26-11:55:44.081636 16 Options.compaction_options_universal.compression_size_percent: -1
2023/09/26-11:55:44.081637 16 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023/09/26-11:55:44.081639 16 Options.compaction_options_fifo.max_table_files_size: 1073741824
2023/09/26-11:55:44.081640 16 Options.compaction_options_fifo.allow_compaction: 0
2023/09/26-11:55:44.081643 16 Options.table_properties_collectors:
2023/09/26-11:55:44.081644 16 Options.inplace_update_support: 0
2023/09/26-11:55:44.081646 16 Options.inplace_update_num_locks: 10000
2023/09/26-11:55:44.081647 16 Options.memtable_prefix_bloom_size_ratio: 0.000000
2023/09/26-11:55:44.081649 16 Options.memtable_whole_key_filtering: 0
2023/09/26-11:55:44.081650 16 Options.memtable_huge_page_size: 0
2023/09/26-11:55:44.081651 16 Options.bloom_locality: 0
2023/09/26-11:55:44.081653 16 Options.max_successive_merges: 0
2023/09/26-11:55:44.081654 16 Options.optimize_filters_for_hits: 0
2023/09/26-11:55:44.081655 16 Options.paranoid_file_checks: 0
2023/09/26-11:55:44.081657 16 Options.force_consistency_checks: 1
2023/09/26-11:55:44.081658 16 Options.report_bg_io_stats: 0
2023/09/26-11:55:44.081659 16 Options.ttl: 2592000
2023/09/26-11:55:44.081661 16 Options.periodic_compaction_seconds: 0
2023/09/26-11:55:44.081662 16 Options.enable_blob_files: false
2023/09/26-11:55:44.081664 16 Options.min_blob_size: 0
2023/09/26-11:55:44.081668 16 Options.blob_file_size: 268435456
2023/09/26-11:55:44.081670 16 Options.blob_compression_type: NoCompression
2023/09/26-11:55:44.081671 16 Options.enable_blob_garbage_collection: false
2023/09/26-11:55:44.081673 16 Options.blob_garbage_collection_age_cutoff: 0.250000
2023/09/26-11:55:44.081674 16 Options.blob_garbage_collection_force_threshold: 1.000000
2023/09/26-11:55:44.081676 16 Options.blob_compaction_readahead_size: 0
2023/09/26-11:55:44.082640 16 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 124, log_number is 6,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023/09/26-11:55:44.082644 16 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 6
2023/09/26-11:55:44.082692 16 [db/version_set.cc:4384] Creating manifest 14
2023/09/26-11:55:44.086428 16 EVENT_LOG_v1 {"time_micros": 1695729344086425, "job": 1, "event": "recovery_started", "wal_files": [11]}
2023/09/26-11:55:44.086432 16 [db/db_impl/db_impl_open.cc:883] Recovering log #11 mode 2
2023/09/26-11:55:44.256400 16 EVENT_LOG_v1 {"time_micros": 1695729344256373, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 15, "file_size": 37541350, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 37537394, "index_size": 3027, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 3740797, "raw_average_key_size": 51, "raw_value_size": 36432821, "raw_average_value_size": 503, "num_data_blocks": 53, "num_entries": 72403, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695729344, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d9d0566a-1f2c-4bbe-bac1-cb7ce4e8a23d", "db_session_id": "LDJPBRCKW95VBBDOA0BD", "orig_file_number": 15}}
2023/09/26-11:55:44.258050 16 [db/version_set.cc:4384] Creating manifest 16
2023/09/26-11:55:44.262135 16 EVENT_LOG_v1 {"time_micros": 1695729344262131, "job": 1, "event": "recovery_finished"}
2023/09/26-11:55:44.270917 16 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data/000011.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
2023/09/26-11:55:44.270940 16 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9f31e55380
2023/09/26-11:55:44.270978 16 DB pointer 0x7f9f31e3ac00
2023/09/26-11:55:47.271169 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:55:47.271190 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3.2 total, 3.2 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3.2 total, 3.2 interval
Flush(GB): cumulative 0.035, interval 0.035
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.03 GB write, 11.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Interval compaction: 0.03 GB write, 11.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 1 last_copies: 1 last_secs: 3.6e-05 secs_since: 3
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:05:47.271343 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:05:47.271375 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 603.2 total, 600.0 interval
Cumulative writes: 6989 writes, 6989 keys, 6989 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.03 MB/s
Cumulative WAL: 6989 writes, 0 syncs, 6989.00 writes per sync, written: 0.02 GB, 0.03 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 6989 writes, 6989 keys, 6989 commit groups, 1.0 writes per commit group, ingest: 17.04 MB, 0.03 MB/s
Interval WAL: 6989 writes, 0 syncs, 6989.00 writes per sync, written: 0.02 GB, 0.03 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 603.2 total, 600.0 interval
Flush(GB): cumulative 0.035, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.03 GB write, 0.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 2 last_copies: 1 last_secs: 4.8e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:15:47.271551 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:15:47.271585 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1203.2 total, 600.0 interval
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
Cumulative WAL: 14K writes, 0 syncs, 14113.00 writes per sync, written: 0.02 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7124 writes, 7124 keys, 7124 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1203.2 total, 600.0 interval
Flush(GB): cumulative 0.035, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.03 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 3 last_copies: 1 last_secs: 5.7e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:25:47.271764 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:25:47.271807 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1803.2 total, 600.0 interval
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
Cumulative WAL: 21K writes, 0 syncs, 21224.00 writes per sync, written: 0.02 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7111 writes, 7111 keys, 7111 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7111 writes, 0 syncs, 7111.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1803.2 total, 600.0 interval
Flush(GB): cumulative 0.035, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.03 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 4 last_copies: 1 last_secs: 4e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:35:47.271962 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:35:47.271993 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 2403.2 total, 600.0 interval
Cumulative writes: 28K writes, 28K keys, 28K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
Cumulative WAL: 28K writes, 0 syncs, 28348.00 writes per sync, written: 0.02 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7124 writes, 7124 keys, 7123 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 2403.2 total, 600.0 interval
Flush(GB): cumulative 0.035, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.03 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 5 last_copies: 1 last_secs: 4.2e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:45:47.272184 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:45:47.272226 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3003.2 total, 600.0 interval
Cumulative writes: 35K writes, 35K keys, 35K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
Cumulative WAL: 35K writes, 0 syncs, 35461.00 writes per sync, written: 0.02 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7113 writes, 7113 keys, 7112 commit groups, 1.0 writes per commit group, ingest: 0.58 MB, 0.00 MB/s
Interval WAL: 7113 writes, 0 syncs, 7113.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3003.2 total, 600.0 interval
Flush(GB): cumulative 0.035, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.03 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 6 last_copies: 1 last_secs: 9.4e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:55:47.272540 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:55:47.272617 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3603.2 total, 600.0 interval
Cumulative writes: 42K writes, 42K keys, 42K commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.01 MB/s
Cumulative WAL: 42K writes, 0 syncs, 42550.00 writes per sync, written: 0.02 GB, 0.01 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7089 writes, 7089 keys, 7083 commit groups, 1.0 writes per commit group, ingest: 0.57 MB, 0.00 MB/s
Interval WAL: 7089 writes, 0 syncs, 7089.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 35.81 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Sum 2/0 35.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 433.6 0.08 0.00 1 0.083 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3603.2 total, 600.0 interval
Flush(GB): cumulative 0.035, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.03 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 7 last_copies: 1 last_secs: 9.1e-05 secs_since: 3
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **

Binary file not shown.

View File

@ -0,0 +1,190 @@
# This is a RocksDB option file.
#
# For detailed file format spec, please refer to the example file
# in examples/rocksdb_option_file_example.ini
#
[Version]
rocksdb_version=6.27.3
options_file_version=1.1
[DBOptions]
max_open_files=-1
stats_history_buffer_size=1048576
stats_persist_period_sec=600
max_background_flushes=1
stats_dump_period_sec=600
compaction_readahead_size=0
bytes_per_sync=0
delete_obsolete_files_period_micros=21600000000
max_total_wal_size=0
delayed_write_rate=16777216
wal_bytes_per_sync=0
writable_file_max_buffer_size=1048576
avoid_flush_during_shutdown=false
max_subcompactions=1
strict_bytes_per_sync=false
max_background_compactions=-1
base_background_compactions=-1
max_background_jobs=1
file_checksum_gen_factory=nullptr
db_host_id=__hostname__
bgerror_resume_retry_interval=1000000
best_efforts_recovery=false
avoid_unnecessary_blocking_io=false
two_write_queues=false
atomic_flush=false
preserve_deletes=false
allow_ingest_behind=false
lowest_used_cache_tier=kNonVolatileBlockTier
avoid_flush_during_recovery=false
info_log_level=INFO_LEVEL
access_hint_on_compaction_start=NORMAL
max_bgerror_resume_count=2147483647
write_thread_slow_yield_usec=3
allow_concurrent_memtable_write=true
WAL_ttl_seconds=0
manual_wal_flush=false
dump_malloc_stats=false
wal_recovery_mode=kPointInTimeRecovery
log_file_time_to_roll=0
enable_write_thread_adaptive_yield=true
recycle_log_file_num=0
table_cache_numshardbits=6
max_file_opening_threads=16
allow_data_in_errors=false
use_fsync=false
unordered_write=false
fail_if_options_file_error=false
random_access_max_buffer_size=1048576
new_table_reader_for_compaction_inputs=false
skip_checking_sst_file_sizes_on_db_open=false
skip_stats_update_on_db_open=false
persist_stats_to_disk=false
track_and_verify_wals_in_manifest=false
enable_pipelined_write=false
flush_verify_memtable_count=true
log_readahead_size=0
is_fd_close_on_exec=true
WAL_size_limit_MB=0
experimental_mempurge_threshold=0.000000
write_dbid_to_manifest=false
use_adaptive_mutex=false
error_if_exists=false
write_thread_max_yield_usec=100
enable_thread_tracking=false
db_write_buffer_size=0
create_missing_column_families=false
paranoid_checks=true
create_if_missing=true
wal_filter=nullptr
max_manifest_file_size=1073741824
allow_2pc=false
use_direct_io_for_flush_and_compaction=false
manifest_preallocation_size=4194304
use_direct_reads=false
allow_fallocate=true
max_write_batch_group_size_bytes=1048576
keep_log_file_num=1000
allow_mmap_reads=false
max_log_file_size=0
allow_mmap_writes=false
advise_random_on_open=true
[CFOptions "default"]
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
bottommost_compression=kDisableCompressionOption
enable_blob_garbage_collection=false
blob_file_size=268435456
sample_for_compression=0
periodic_compaction_seconds=0
ttl=2592000
blob_garbage_collection_age_cutoff=0.250000
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
compression=kNoCompression
max_sequential_skip_in_iterations=8
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
max_bytes_for_level_multiplier=10.000000
max_bytes_for_level_base=268435456
memtable_whole_key_filtering=false
max_successive_merges=0
blob_compaction_readahead_size=0
inplace_update_num_locks=10000
arena_block_size=1048576
target_file_size_multiplier=2
prefix_extractor=nullptr
max_write_buffer_number=2
blob_compression_type=kNoCompression
level0_stop_writes_trigger=36
level0_slowdown_writes_trigger=20
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
level0_file_num_compaction_trigger=4
write_buffer_size=67108864
memtable_huge_page_size=0
max_compaction_bytes=1677721600
min_blob_size=0
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
hard_pending_compaction_bytes_limit=274877906944
target_file_size_base=67108864
soft_pending_compaction_bytes_limit=68719476736
enable_blob_files=false
paranoid_file_checks=false
check_flush_compaction_key_order=true
blob_garbage_collection_force_threshold=1.000000
disable_auto_compactions=false
memtable_prefix_bloom_size_ratio=0.000000
report_bg_io_stats=false
compaction_pri=kMinOverlappingRatio
compaction_filter_factory=nullptr
comparator=leveldb.BytewiseComparator
sst_partitioner_factory=nullptr
bloom_locality=0
compaction_style=kCompactionStyleLevel
min_write_buffer_number_to_merge=1
max_write_buffer_size_to_maintain=0
max_write_buffer_number_to_maintain=0
merge_operator=nullptr
memtable_factory=SkipListFactory
memtable_insert_with_hint_prefix_extractor=nullptr
compression_per_level=kNoCompression:kZSTD:kZSTD
num_levels=7
force_consistency_checks=true
optimize_filters_for_hits=false
compaction_filter=nullptr
level_compaction_dynamic_level_bytes=false
inplace_update_support=false
table_factory=BlockBasedTable
[TableOptions/BlockBasedTable "default"]
pin_top_level_index_and_filter=true
block_align=false
read_amp_bytes_per_bit=0
verify_compression=false
enable_index_compression=true
reserve_table_builder_memory=false
whole_key_filtering=true
max_auto_readahead_size=262144
optimize_filters_for_memory=false
index_block_restart_interval=1
prepopulate_block_cache=kDisable
block_restart_interval=16
block_size=65536
format_version=5
partition_filters=false
block_size_deviation=10
no_block_cache=false
checksum=kCRC32c
data_block_hash_table_util_ratio=0.750000
index_shortening=kShortenSeparators
data_block_index_type=kDataBlockBinarySearch
hash_index_allow_collision=true
filter_policy=nullptr
metadata_block_size=4096
index_type=kBinarySearch
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
pin_l0_filter_and_index_blocks_in_cache=false
cache_index_and_filter_blocks_with_high_priority=true
cache_index_and_filter_blocks=false
flush_block_policy_factory=FlushBlockBySizePolicyFactory

View File

@ -0,0 +1,190 @@
# This is a RocksDB option file.
#
# For detailed file format spec, please refer to the example file
# in examples/rocksdb_option_file_example.ini
#
[Version]
rocksdb_version=6.27.3
options_file_version=1.1
[DBOptions]
max_open_files=-1
stats_history_buffer_size=1048576
stats_persist_period_sec=600
max_background_flushes=1
stats_dump_period_sec=600
compaction_readahead_size=0
bytes_per_sync=0
delete_obsolete_files_period_micros=21600000000
max_total_wal_size=0
delayed_write_rate=16777216
wal_bytes_per_sync=0
writable_file_max_buffer_size=1048576
avoid_flush_during_shutdown=false
max_subcompactions=1
strict_bytes_per_sync=false
max_background_compactions=-1
base_background_compactions=-1
max_background_jobs=1
file_checksum_gen_factory=nullptr
db_host_id=__hostname__
bgerror_resume_retry_interval=1000000
best_efforts_recovery=false
avoid_unnecessary_blocking_io=false
two_write_queues=false
atomic_flush=false
preserve_deletes=false
allow_ingest_behind=false
lowest_used_cache_tier=kNonVolatileBlockTier
avoid_flush_during_recovery=false
info_log_level=INFO_LEVEL
access_hint_on_compaction_start=NORMAL
max_bgerror_resume_count=2147483647
write_thread_slow_yield_usec=3
allow_concurrent_memtable_write=true
WAL_ttl_seconds=0
manual_wal_flush=false
dump_malloc_stats=false
wal_recovery_mode=kPointInTimeRecovery
log_file_time_to_roll=0
enable_write_thread_adaptive_yield=true
recycle_log_file_num=0
table_cache_numshardbits=6
max_file_opening_threads=16
allow_data_in_errors=false
use_fsync=false
unordered_write=false
fail_if_options_file_error=false
random_access_max_buffer_size=1048576
new_table_reader_for_compaction_inputs=false
skip_checking_sst_file_sizes_on_db_open=false
skip_stats_update_on_db_open=false
persist_stats_to_disk=false
track_and_verify_wals_in_manifest=false
enable_pipelined_write=false
flush_verify_memtable_count=true
log_readahead_size=0
is_fd_close_on_exec=true
WAL_size_limit_MB=0
experimental_mempurge_threshold=0.000000
write_dbid_to_manifest=false
use_adaptive_mutex=false
error_if_exists=false
write_thread_max_yield_usec=100
enable_thread_tracking=false
db_write_buffer_size=0
create_missing_column_families=false
paranoid_checks=true
create_if_missing=true
wal_filter=nullptr
max_manifest_file_size=1073741824
allow_2pc=false
use_direct_io_for_flush_and_compaction=false
manifest_preallocation_size=4194304
use_direct_reads=false
allow_fallocate=true
max_write_batch_group_size_bytes=1048576
keep_log_file_num=1000
allow_mmap_reads=false
max_log_file_size=0
allow_mmap_writes=false
advise_random_on_open=true
[CFOptions "default"]
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
bottommost_compression=kDisableCompressionOption
enable_blob_garbage_collection=false
blob_file_size=268435456
sample_for_compression=0
periodic_compaction_seconds=0
ttl=2592000
blob_garbage_collection_age_cutoff=0.250000
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
compression=kNoCompression
max_sequential_skip_in_iterations=8
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
max_bytes_for_level_multiplier=10.000000
max_bytes_for_level_base=268435456
memtable_whole_key_filtering=false
max_successive_merges=0
blob_compaction_readahead_size=0
inplace_update_num_locks=10000
arena_block_size=1048576
target_file_size_multiplier=2
prefix_extractor=nullptr
max_write_buffer_number=2
blob_compression_type=kNoCompression
level0_stop_writes_trigger=36
level0_slowdown_writes_trigger=20
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
level0_file_num_compaction_trigger=4
write_buffer_size=67108864
memtable_huge_page_size=0
max_compaction_bytes=1677721600
min_blob_size=0
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
hard_pending_compaction_bytes_limit=274877906944
target_file_size_base=67108864
soft_pending_compaction_bytes_limit=68719476736
enable_blob_files=false
paranoid_file_checks=false
check_flush_compaction_key_order=true
blob_garbage_collection_force_threshold=1.000000
disable_auto_compactions=false
memtable_prefix_bloom_size_ratio=0.000000
report_bg_io_stats=false
compaction_pri=kMinOverlappingRatio
compaction_filter_factory=nullptr
comparator=leveldb.BytewiseComparator
sst_partitioner_factory=nullptr
bloom_locality=0
compaction_style=kCompactionStyleLevel
min_write_buffer_number_to_merge=1
max_write_buffer_size_to_maintain=0
max_write_buffer_number_to_maintain=0
merge_operator=nullptr
memtable_factory=SkipListFactory
memtable_insert_with_hint_prefix_extractor=nullptr
compression_per_level=kNoCompression:kZSTD:kZSTD
num_levels=7
force_consistency_checks=true
optimize_filters_for_hits=false
compaction_filter=nullptr
level_compaction_dynamic_level_bytes=false
inplace_update_support=false
table_factory=BlockBasedTable
[TableOptions/BlockBasedTable "default"]
pin_top_level_index_and_filter=true
block_align=false
read_amp_bytes_per_bit=0
verify_compression=false
enable_index_compression=true
reserve_table_builder_memory=false
whole_key_filtering=true
max_auto_readahead_size=262144
optimize_filters_for_memory=false
index_block_restart_interval=1
prepopulate_block_cache=kDisable
block_restart_interval=16
block_size=65536
format_version=5
partition_filters=false
block_size_deviation=10
no_block_cache=false
checksum=kCRC32c
data_block_hash_table_util_ratio=0.750000
index_shortening=kShortenSeparators
data_block_index_type=kDataBlockBinarySearch
hash_index_allow_collision=true
filter_policy=nullptr
metadata_block_size=4096
index_type=kBinarySearch
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
pin_l0_filter_and_index_blocks_in_cache=false
cache_index_and_filter_blocks_with_high_priority=true
cache_index_and_filter_blocks=false
flush_block_policy_factory=FlushBlockBySizePolicyFactory

Binary file not shown.

Binary file not shown.

Binary file not shown.

Binary file not shown.

View File

@ -0,0 +1 @@
MANIFEST-000022

View File

@ -0,0 +1 @@
cf0fe53a-7182-458f-baa9-e07d3ffe5860

View File

View File

@ -0,0 +1,395 @@
2023/09/26-17:03:48.661505 14 RocksDB version: 6.27.3
2023/09/26-17:03:48.661926 14 Git sha 0
2023/09/26-17:03:48.661928 14 Compile date 2023-06-14 04:09:40
2023/09/26-17:03:48.662068 14 DB SUMMARY
2023/09/26-17:03:48.662069 14 DB Session ID: 345C9WGIGWXHNGD85BUM
2023/09/26-17:03:48.662351 14 CURRENT file: CURRENT
2023/09/26-17:03:48.662352 14 IDENTITY file: IDENTITY
2023/09/26-17:03:48.662357 14 MANIFEST file: MANIFEST-000016 size: 315 Bytes
2023/09/26-17:03:48.662358 14 SST files in /var/lib/milvus/rdb_data_meta_kv dir, Total Num: 2, files: 000009.sst 000015.sst
2023/09/26-17:03:48.662359 14 Write Ahead Log file in /var/lib/milvus/rdb_data_meta_kv: 000017.log size: 3209895 ;
2023/09/26-17:03:48.662360 14 Options.error_if_exists: 0
2023/09/26-17:03:48.662361 14 Options.create_if_missing: 1
2023/09/26-17:03:48.662362 14 Options.paranoid_checks: 1
2023/09/26-17:03:48.662363 14 Options.flush_verify_memtable_count: 1
2023/09/26-17:03:48.662364 14 Options.track_and_verify_wals_in_manifest: 0
2023/09/26-17:03:48.662364 14 Options.env: 0x5e1d140
2023/09/26-17:03:48.662366 14 Options.fs: PosixFileSystem
2023/09/26-17:03:48.662367 14 Options.info_log: 0x7f9d2084e050
2023/09/26-17:03:48.662367 14 Options.max_file_opening_threads: 16
2023/09/26-17:03:48.662368 14 Options.statistics: (nil)
2023/09/26-17:03:48.662369 14 Options.use_fsync: 0
2023/09/26-17:03:48.662370 14 Options.max_log_file_size: 0
2023/09/26-17:03:48.662370 14 Options.max_manifest_file_size: 1073741824
2023/09/26-17:03:48.662371 14 Options.log_file_time_to_roll: 0
2023/09/26-17:03:48.662372 14 Options.keep_log_file_num: 1000
2023/09/26-17:03:48.662373 14 Options.recycle_log_file_num: 0
2023/09/26-17:03:48.662374 14 Options.allow_fallocate: 1
2023/09/26-17:03:48.662375 14 Options.allow_mmap_reads: 0
2023/09/26-17:03:48.662375 14 Options.allow_mmap_writes: 0
2023/09/26-17:03:48.662376 14 Options.use_direct_reads: 0
2023/09/26-17:03:48.662377 14 Options.use_direct_io_for_flush_and_compaction: 0
2023/09/26-17:03:48.662377 14 Options.create_missing_column_families: 0
2023/09/26-17:03:48.662378 14 Options.db_log_dir:
2023/09/26-17:03:48.662379 14 Options.wal_dir:
2023/09/26-17:03:48.662380 14 Options.table_cache_numshardbits: 6
2023/09/26-17:03:48.662380 14 Options.WAL_ttl_seconds: 0
2023/09/26-17:03:48.662381 14 Options.WAL_size_limit_MB: 0
2023/09/26-17:03:48.662382 14 Options.max_write_batch_group_size_bytes: 1048576
2023/09/26-17:03:48.662383 14 Options.manifest_preallocation_size: 4194304
2023/09/26-17:03:48.662384 14 Options.is_fd_close_on_exec: 1
2023/09/26-17:03:48.662385 14 Options.advise_random_on_open: 1
2023/09/26-17:03:48.662385 14 Options.experimental_mempurge_threshold: 0.000000
2023/09/26-17:03:48.662545 14 Options.db_write_buffer_size: 0
2023/09/26-17:03:48.662546 14 Options.write_buffer_manager: 0x7f9d2080a0a0
2023/09/26-17:03:48.662547 14 Options.access_hint_on_compaction_start: 1
2023/09/26-17:03:48.662548 14 Options.new_table_reader_for_compaction_inputs: 0
2023/09/26-17:03:48.662548 14 Options.random_access_max_buffer_size: 1048576
2023/09/26-17:03:48.662549 14 Options.use_adaptive_mutex: 0
2023/09/26-17:03:48.662550 14 Options.rate_limiter: (nil)
2023/09/26-17:03:48.662551 14 Options.sst_file_manager.rate_bytes_per_sec: 0
2023/09/26-17:03:48.662552 14 Options.wal_recovery_mode: 2
2023/09/26-17:03:48.662559 14 Options.enable_thread_tracking: 0
2023/09/26-17:03:48.662560 14 Options.enable_pipelined_write: 0
2023/09/26-17:03:48.662561 14 Options.unordered_write: 0
2023/09/26-17:03:48.662561 14 Options.allow_concurrent_memtable_write: 1
2023/09/26-17:03:48.662562 14 Options.enable_write_thread_adaptive_yield: 1
2023/09/26-17:03:48.662563 14 Options.write_thread_max_yield_usec: 100
2023/09/26-17:03:48.662563 14 Options.write_thread_slow_yield_usec: 3
2023/09/26-17:03:48.662564 14 Options.row_cache: None
2023/09/26-17:03:48.662565 14 Options.wal_filter: None
2023/09/26-17:03:48.662567 14 Options.avoid_flush_during_recovery: 0
2023/09/26-17:03:48.662568 14 Options.allow_ingest_behind: 0
2023/09/26-17:03:48.662569 14 Options.preserve_deletes: 0
2023/09/26-17:03:48.662569 14 Options.two_write_queues: 0
2023/09/26-17:03:48.662570 14 Options.manual_wal_flush: 0
2023/09/26-17:03:48.662571 14 Options.atomic_flush: 0
2023/09/26-17:03:48.662571 14 Options.avoid_unnecessary_blocking_io: 0
2023/09/26-17:03:48.662572 14 Options.persist_stats_to_disk: 0
2023/09/26-17:03:48.662573 14 Options.write_dbid_to_manifest: 0
2023/09/26-17:03:48.662573 14 Options.log_readahead_size: 0
2023/09/26-17:03:48.662574 14 Options.file_checksum_gen_factory: Unknown
2023/09/26-17:03:48.662575 14 Options.best_efforts_recovery: 0
2023/09/26-17:03:48.662575 14 Options.max_bgerror_resume_count: 2147483647
2023/09/26-17:03:48.662576 14 Options.bgerror_resume_retry_interval: 1000000
2023/09/26-17:03:48.662577 14 Options.allow_data_in_errors: 0
2023/09/26-17:03:48.662577 14 Options.db_host_id: __hostname__
2023/09/26-17:03:48.662578 14 Options.max_background_jobs: 1
2023/09/26-17:03:48.662579 14 Options.max_background_compactions: -1
2023/09/26-17:03:48.662579 14 Options.max_subcompactions: 1
2023/09/26-17:03:48.662580 14 Options.avoid_flush_during_shutdown: 0
2023/09/26-17:03:48.662581 14 Options.writable_file_max_buffer_size: 1048576
2023/09/26-17:03:48.662581 14 Options.delayed_write_rate : 16777216
2023/09/26-17:03:48.662582 14 Options.max_total_wal_size: 0
2023/09/26-17:03:48.662583 14 Options.delete_obsolete_files_period_micros: 21600000000
2023/09/26-17:03:48.662583 14 Options.stats_dump_period_sec: 600
2023/09/26-17:03:48.662584 14 Options.stats_persist_period_sec: 600
2023/09/26-17:03:48.662585 14 Options.stats_history_buffer_size: 1048576
2023/09/26-17:03:48.662585 14 Options.max_open_files: -1
2023/09/26-17:03:48.662586 14 Options.bytes_per_sync: 0
2023/09/26-17:03:48.662587 14 Options.wal_bytes_per_sync: 0
2023/09/26-17:03:48.662587 14 Options.strict_bytes_per_sync: 0
2023/09/26-17:03:48.662588 14 Options.compaction_readahead_size: 0
2023/09/26-17:03:48.662589 14 Options.max_background_flushes: 1
2023/09/26-17:03:48.662589 14 Compression algorithms supported:
2023/09/26-17:03:48.662590 14 kZSTDNotFinalCompression supported: 1
2023/09/26-17:03:48.662591 14 kZSTD supported: 1
2023/09/26-17:03:48.662592 14 kXpressCompression supported: 0
2023/09/26-17:03:48.662593 14 kLZ4HCCompression supported: 0
2023/09/26-17:03:48.662593 14 kLZ4Compression supported: 0
2023/09/26-17:03:48.662594 14 kBZip2Compression supported: 0
2023/09/26-17:03:48.662595 14 kZlibCompression supported: 0
2023/09/26-17:03:48.662595 14 kSnappyCompression supported: 0
2023/09/26-17:03:48.662597 14 Fast CRC32 supported: Supported on x86
2023/09/26-17:03:48.662771 14 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data_meta_kv/MANIFEST-000016
2023/09/26-17:03:48.663306 14 [db/column_family.cc:605] --------------- Options for column family [default]:
2023/09/26-17:03:48.663308 14 Options.comparator: leveldb.BytewiseComparator
2023/09/26-17:03:48.663309 14 Options.merge_operator: None
2023/09/26-17:03:48.663310 14 Options.compaction_filter: None
2023/09/26-17:03:48.663310 14 Options.compaction_filter_factory: None
2023/09/26-17:03:48.663311 14 Options.sst_partitioner_factory: None
2023/09/26-17:03:48.663312 14 Options.memtable_factory: SkipListFactory
2023/09/26-17:03:48.663313 14 Options.table_factory: BlockBasedTable
2023/09/26-17:03:48.663331 14 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9d208000e0)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x7f9d2080a010
block_cache_name: LRUCache
block_cache_options:
capacity : 2502992855
num_shard_bits : 6
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.500
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 65536
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
2023/09/26-17:03:48.663334 14 Options.write_buffer_size: 67108864
2023/09/26-17:03:48.663335 14 Options.max_write_buffer_number: 2
2023/09/26-17:03:48.663335 14 Options.compression[0]: NoCompression
2023/09/26-17:03:48.663336 14 Options.compression[1]: ZSTD
2023/09/26-17:03:48.663337 14 Options.compression[2]: ZSTD
2023/09/26-17:03:48.663338 14 Options.bottommost_compression: Disabled
2023/09/26-17:03:48.663339 14 Options.prefix_extractor: nullptr
2023/09/26-17:03:48.663340 14 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023/09/26-17:03:48.663340 14 Options.num_levels: 3
2023/09/26-17:03:48.663341 14 Options.min_write_buffer_number_to_merge: 1
2023/09/26-17:03:48.663342 14 Options.max_write_buffer_number_to_maintain: 0
2023/09/26-17:03:48.663343 14 Options.max_write_buffer_size_to_maintain: 0
2023/09/26-17:03:48.663343 14 Options.bottommost_compression_opts.window_bits: -14
2023/09/26-17:03:48.663344 14 Options.bottommost_compression_opts.level: 32767
2023/09/26-17:03:48.663345 14 Options.bottommost_compression_opts.strategy: 0
2023/09/26-17:03:48.663346 14 Options.bottommost_compression_opts.max_dict_bytes: 0
2023/09/26-17:03:48.663347 14 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023/09/26-17:03:48.663348 14 Options.bottommost_compression_opts.parallel_threads: 1
2023/09/26-17:03:48.663348 14 Options.bottommost_compression_opts.enabled: false
2023/09/26-17:03:48.663349 14 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2023/09/26-17:03:48.663350 14 Options.compression_opts.window_bits: -14
2023/09/26-17:03:48.663351 14 Options.compression_opts.level: 32767
2023/09/26-17:03:48.663352 14 Options.compression_opts.strategy: 0
2023/09/26-17:03:48.663353 14 Options.compression_opts.max_dict_bytes: 0
2023/09/26-17:03:48.663353 14 Options.compression_opts.zstd_max_train_bytes: 0
2023/09/26-17:03:48.663354 14 Options.compression_opts.parallel_threads: 1
2023/09/26-17:03:48.663355 14 Options.compression_opts.enabled: false
2023/09/26-17:03:48.663359 14 Options.compression_opts.max_dict_buffer_bytes: 0
2023/09/26-17:03:48.663360 14 Options.level0_file_num_compaction_trigger: 4
2023/09/26-17:03:48.663361 14 Options.level0_slowdown_writes_trigger: 20
2023/09/26-17:03:48.663362 14 Options.level0_stop_writes_trigger: 36
2023/09/26-17:03:48.663363 14 Options.target_file_size_base: 67108864
2023/09/26-17:03:48.663363 14 Options.target_file_size_multiplier: 2
2023/09/26-17:03:48.663364 14 Options.max_bytes_for_level_base: 268435456
2023/09/26-17:03:48.663365 14 Options.level_compaction_dynamic_level_bytes: 0
2023/09/26-17:03:48.663366 14 Options.max_bytes_for_level_multiplier: 10.000000
2023/09/26-17:03:48.663368 14 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023/09/26-17:03:48.663368 14 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023/09/26-17:03:48.663369 14 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023/09/26-17:03:48.663370 14 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023/09/26-17:03:48.663371 14 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023/09/26-17:03:48.663372 14 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023/09/26-17:03:48.663372 14 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023/09/26-17:03:48.663373 14 Options.max_sequential_skip_in_iterations: 8
2023/09/26-17:03:48.663374 14 Options.max_compaction_bytes: 1677721600
2023/09/26-17:03:48.663375 14 Options.arena_block_size: 1048576
2023/09/26-17:03:48.663375 14 Options.soft_pending_compaction_bytes_limit: 68719476736
2023/09/26-17:03:48.663376 14 Options.hard_pending_compaction_bytes_limit: 274877906944
2023/09/26-17:03:48.663377 14 Options.rate_limit_delay_max_milliseconds: 100
2023/09/26-17:03:48.663378 14 Options.disable_auto_compactions: 0
2023/09/26-17:03:48.663379 14 Options.compaction_style: kCompactionStyleLevel
2023/09/26-17:03:48.663380 14 Options.compaction_pri: kMinOverlappingRatio
2023/09/26-17:03:48.663381 14 Options.compaction_options_universal.size_ratio: 1
2023/09/26-17:03:48.663382 14 Options.compaction_options_universal.min_merge_width: 2
2023/09/26-17:03:48.663382 14 Options.compaction_options_universal.max_merge_width: 4294967295
2023/09/26-17:03:48.663383 14 Options.compaction_options_universal.max_size_amplification_percent: 200
2023/09/26-17:03:48.663384 14 Options.compaction_options_universal.compression_size_percent: -1
2023/09/26-17:03:48.663385 14 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023/09/26-17:03:48.663386 14 Options.compaction_options_fifo.max_table_files_size: 1073741824
2023/09/26-17:03:48.663387 14 Options.compaction_options_fifo.allow_compaction: 0
2023/09/26-17:03:48.663389 14 Options.table_properties_collectors:
2023/09/26-17:03:48.663390 14 Options.inplace_update_support: 0
2023/09/26-17:03:48.663390 14 Options.inplace_update_num_locks: 10000
2023/09/26-17:03:48.663391 14 Options.memtable_prefix_bloom_size_ratio: 0.000000
2023/09/26-17:03:48.663392 14 Options.memtable_whole_key_filtering: 0
2023/09/26-17:03:48.663393 14 Options.memtable_huge_page_size: 0
2023/09/26-17:03:48.663393 14 Options.bloom_locality: 0
2023/09/26-17:03:48.663394 14 Options.max_successive_merges: 0
2023/09/26-17:03:48.663395 14 Options.optimize_filters_for_hits: 0
2023/09/26-17:03:48.663395 14 Options.paranoid_file_checks: 0
2023/09/26-17:03:48.663396 14 Options.force_consistency_checks: 1
2023/09/26-17:03:48.663397 14 Options.report_bg_io_stats: 0
2023/09/26-17:03:48.663397 14 Options.ttl: 2592000
2023/09/26-17:03:48.663398 14 Options.periodic_compaction_seconds: 0
2023/09/26-17:03:48.663399 14 Options.enable_blob_files: false
2023/09/26-17:03:48.663401 14 Options.min_blob_size: 0
2023/09/26-17:03:48.663402 14 Options.blob_file_size: 268435456
2023/09/26-17:03:48.663403 14 Options.blob_compression_type: NoCompression
2023/09/26-17:03:48.663404 14 Options.enable_blob_garbage_collection: false
2023/09/26-17:03:48.663404 14 Options.blob_garbage_collection_age_cutoff: 0.250000
2023/09/26-17:03:48.663405 14 Options.blob_garbage_collection_force_threshold: 1.000000
2023/09/26-17:03:48.663406 14 Options.blob_compaction_readahead_size: 0
2023/09/26-17:03:48.664513 14 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data_meta_kv/MANIFEST-000016 succeeded,manifest_file_number is 16, next_file_number is 18, last_sequence is 72567, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023/09/26-17:03:48.664517 14 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 12
2023/09/26-17:03:48.664691 14 [db/version_set.cc:4384] Creating manifest 20
2023/09/26-17:03:48.668593 14 EVENT_LOG_v1 {"time_micros": 1695747828668585, "job": 1, "event": "recovery_started", "wal_files": [17]}
2023/09/26-17:03:48.668596 14 [db/db_impl/db_impl_open.cc:883] Recovering log #17 mode 2
2023/09/26-17:03:48.691746 14 EVENT_LOG_v1 {"time_micros": 1695747828691727, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 21, "file_size": 1100, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 159, "index_size": 24, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 156, "raw_average_key_size": 39, "raw_value_size": 29, "raw_average_value_size": 7, "num_data_blocks": 1, "num_entries": 4, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695747828, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf0fe53a-7182-458f-baa9-e07d3ffe5860", "db_session_id": "345C9WGIGWXHNGD85BUM", "orig_file_number": 21}}
2023/09/26-17:03:48.691768 14 [db/version_set.cc:4384] Creating manifest 22
2023/09/26-17:03:48.698062 14 EVENT_LOG_v1 {"time_micros": 1695747828698061, "job": 1, "event": "recovery_finished"}
2023/09/26-17:03:48.701551 14 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data_meta_kv/000017.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
2023/09/26-17:03:48.701562 14 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9d20855000
2023/09/26-17:03:48.701580 14 DB pointer 0x7f9d20839000
2023/09/26-17:03:48.701758 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:03:48.701772 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 0.0 total, 0.0 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 0.0 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 1 last_copies: 0 last_secs: 2.9e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-17:13:48.702139 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:13:48.702207 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 600.0 total, 600.0 interval
Cumulative writes: 7017 writes, 7017 keys, 7016 commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 7017 writes, 0 syncs, 7017.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7017 writes, 7017 keys, 7016 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
Interval WAL: 7017 writes, 0 syncs, 7017.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 600.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 2 last_copies: 0 last_secs: 9.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-17:23:48.702567 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:23:48.702636 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1200.0 total, 600.0 interval
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 14K writes, 0 syncs, 14217.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1200.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 3 last_copies: 0 last_secs: 9e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-17:33:48.703140 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-17:33:48.703205 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1800.0 total, 600.0 interval
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 21K writes, 0 syncs, 21417.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7200 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 4.06 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Sum 3/0 4.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.4 0.00 0.00 1 0.003 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1800.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9d2080a010#7 capacity: 2.33 GB collections: 4 last_copies: 0 last_secs: 0.000227 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(9,6.23 MB,0.261175%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **

File diff suppressed because it is too large Load Diff

View File

@ -0,0 +1,815 @@
2023/09/26-09:25:26.684985 17 RocksDB version: 6.27.3
2023/09/26-09:25:26.685027 17 Git sha 0
2023/09/26-09:25:26.685028 17 Compile date 2023-06-14 04:09:40
2023/09/26-09:25:26.685031 17 DB SUMMARY
2023/09/26-09:25:26.685032 17 DB Session ID: 6O2QNLLK9Q04IJ9PYGWV
2023/09/26-09:25:26.685050 17 CURRENT file: CURRENT
2023/09/26-09:25:26.685051 17 IDENTITY file: IDENTITY
2023/09/26-09:25:26.685054 17 MANIFEST file: MANIFEST-000004 size: 57 Bytes
2023/09/26-09:25:26.685055 17 SST files in /var/lib/milvus/rdb_data_meta_kv dir, Total Num: 0, files:
2023/09/26-09:25:26.685056 17 Write Ahead Log file in /var/lib/milvus/rdb_data_meta_kv: 000005.log size: 9661 ;
2023/09/26-09:25:26.685057 17 Options.error_if_exists: 0
2023/09/26-09:25:26.685058 17 Options.create_if_missing: 1
2023/09/26-09:25:26.685059 17 Options.paranoid_checks: 1
2023/09/26-09:25:26.685059 17 Options.flush_verify_memtable_count: 1
2023/09/26-09:25:26.685060 17 Options.track_and_verify_wals_in_manifest: 0
2023/09/26-09:25:26.685061 17 Options.env: 0x5e1d140
2023/09/26-09:25:26.685062 17 Options.fs: PosixFileSystem
2023/09/26-09:25:26.685063 17 Options.info_log: 0x7f9133a1a0a0
2023/09/26-09:25:26.685063 17 Options.max_file_opening_threads: 16
2023/09/26-09:25:26.685064 17 Options.statistics: (nil)
2023/09/26-09:25:26.685065 17 Options.use_fsync: 0
2023/09/26-09:25:26.685065 17 Options.max_log_file_size: 0
2023/09/26-09:25:26.685066 17 Options.max_manifest_file_size: 1073741824
2023/09/26-09:25:26.685067 17 Options.log_file_time_to_roll: 0
2023/09/26-09:25:26.685068 17 Options.keep_log_file_num: 1000
2023/09/26-09:25:26.685068 17 Options.recycle_log_file_num: 0
2023/09/26-09:25:26.685069 17 Options.allow_fallocate: 1
2023/09/26-09:25:26.685070 17 Options.allow_mmap_reads: 0
2023/09/26-09:25:26.685070 17 Options.allow_mmap_writes: 0
2023/09/26-09:25:26.685071 17 Options.use_direct_reads: 0
2023/09/26-09:25:26.685072 17 Options.use_direct_io_for_flush_and_compaction: 0
2023/09/26-09:25:26.685072 17 Options.create_missing_column_families: 0
2023/09/26-09:25:26.685073 17 Options.db_log_dir:
2023/09/26-09:25:26.685074 17 Options.wal_dir:
2023/09/26-09:25:26.685074 17 Options.table_cache_numshardbits: 6
2023/09/26-09:25:26.685075 17 Options.WAL_ttl_seconds: 0
2023/09/26-09:25:26.685076 17 Options.WAL_size_limit_MB: 0
2023/09/26-09:25:26.685076 17 Options.max_write_batch_group_size_bytes: 1048576
2023/09/26-09:25:26.685077 17 Options.manifest_preallocation_size: 4194304
2023/09/26-09:25:26.685078 17 Options.is_fd_close_on_exec: 1
2023/09/26-09:25:26.685078 17 Options.advise_random_on_open: 1
2023/09/26-09:25:26.685079 17 Options.experimental_mempurge_threshold: 0.000000
2023/09/26-09:25:26.685088 17 Options.db_write_buffer_size: 0
2023/09/26-09:25:26.685089 17 Options.write_buffer_manager: 0x7f9133a250a0
2023/09/26-09:25:26.685089 17 Options.access_hint_on_compaction_start: 1
2023/09/26-09:25:26.685090 17 Options.new_table_reader_for_compaction_inputs: 0
2023/09/26-09:25:26.685091 17 Options.random_access_max_buffer_size: 1048576
2023/09/26-09:25:26.685091 17 Options.use_adaptive_mutex: 0
2023/09/26-09:25:26.685092 17 Options.rate_limiter: (nil)
2023/09/26-09:25:26.685093 17 Options.sst_file_manager.rate_bytes_per_sec: 0
2023/09/26-09:25:26.685094 17 Options.wal_recovery_mode: 2
2023/09/26-09:25:26.685101 17 Options.enable_thread_tracking: 0
2023/09/26-09:25:26.685102 17 Options.enable_pipelined_write: 0
2023/09/26-09:25:26.685102 17 Options.unordered_write: 0
2023/09/26-09:25:26.685103 17 Options.allow_concurrent_memtable_write: 1
2023/09/26-09:25:26.685104 17 Options.enable_write_thread_adaptive_yield: 1
2023/09/26-09:25:26.685104 17 Options.write_thread_max_yield_usec: 100
2023/09/26-09:25:26.685105 17 Options.write_thread_slow_yield_usec: 3
2023/09/26-09:25:26.685106 17 Options.row_cache: None
2023/09/26-09:25:26.685106 17 Options.wal_filter: None
2023/09/26-09:25:26.685109 17 Options.avoid_flush_during_recovery: 0
2023/09/26-09:25:26.685110 17 Options.allow_ingest_behind: 0
2023/09/26-09:25:26.685110 17 Options.preserve_deletes: 0
2023/09/26-09:25:26.685111 17 Options.two_write_queues: 0
2023/09/26-09:25:26.685112 17 Options.manual_wal_flush: 0
2023/09/26-09:25:26.685112 17 Options.atomic_flush: 0
2023/09/26-09:25:26.685113 17 Options.avoid_unnecessary_blocking_io: 0
2023/09/26-09:25:26.685114 17 Options.persist_stats_to_disk: 0
2023/09/26-09:25:26.685114 17 Options.write_dbid_to_manifest: 0
2023/09/26-09:25:26.685115 17 Options.log_readahead_size: 0
2023/09/26-09:25:26.685116 17 Options.file_checksum_gen_factory: Unknown
2023/09/26-09:25:26.685116 17 Options.best_efforts_recovery: 0
2023/09/26-09:25:26.685117 17 Options.max_bgerror_resume_count: 2147483647
2023/09/26-09:25:26.685118 17 Options.bgerror_resume_retry_interval: 1000000
2023/09/26-09:25:26.685119 17 Options.allow_data_in_errors: 0
2023/09/26-09:25:26.685119 17 Options.db_host_id: __hostname__
2023/09/26-09:25:26.685120 17 Options.max_background_jobs: 1
2023/09/26-09:25:26.685120 17 Options.max_background_compactions: -1
2023/09/26-09:25:26.685121 17 Options.max_subcompactions: 1
2023/09/26-09:25:26.685122 17 Options.avoid_flush_during_shutdown: 0
2023/09/26-09:25:26.685123 17 Options.writable_file_max_buffer_size: 1048576
2023/09/26-09:25:26.685123 17 Options.delayed_write_rate : 16777216
2023/09/26-09:25:26.685124 17 Options.max_total_wal_size: 0
2023/09/26-09:25:26.685125 17 Options.delete_obsolete_files_period_micros: 21600000000
2023/09/26-09:25:26.685125 17 Options.stats_dump_period_sec: 600
2023/09/26-09:25:26.685126 17 Options.stats_persist_period_sec: 600
2023/09/26-09:25:26.685127 17 Options.stats_history_buffer_size: 1048576
2023/09/26-09:25:26.685127 17 Options.max_open_files: -1
2023/09/26-09:25:26.685128 17 Options.bytes_per_sync: 0
2023/09/26-09:25:26.685129 17 Options.wal_bytes_per_sync: 0
2023/09/26-09:25:26.685129 17 Options.strict_bytes_per_sync: 0
2023/09/26-09:25:26.685130 17 Options.compaction_readahead_size: 0
2023/09/26-09:25:26.685131 17 Options.max_background_flushes: 1
2023/09/26-09:25:26.685131 17 Compression algorithms supported:
2023/09/26-09:25:26.685132 17 kZSTDNotFinalCompression supported: 1
2023/09/26-09:25:26.685133 17 kZSTD supported: 1
2023/09/26-09:25:26.685134 17 kXpressCompression supported: 0
2023/09/26-09:25:26.685135 17 kLZ4HCCompression supported: 0
2023/09/26-09:25:26.685135 17 kLZ4Compression supported: 0
2023/09/26-09:25:26.685136 17 kBZip2Compression supported: 0
2023/09/26-09:25:26.685137 17 kZlibCompression supported: 0
2023/09/26-09:25:26.685137 17 kSnappyCompression supported: 0
2023/09/26-09:25:26.685139 17 Fast CRC32 supported: Supported on x86
2023/09/26-09:25:26.685174 17 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data_meta_kv/MANIFEST-000004
2023/09/26-09:25:26.685282 17 [db/column_family.cc:605] --------------- Options for column family [default]:
2023/09/26-09:25:26.685283 17 Options.comparator: leveldb.BytewiseComparator
2023/09/26-09:25:26.685284 17 Options.merge_operator: None
2023/09/26-09:25:26.685285 17 Options.compaction_filter: None
2023/09/26-09:25:26.685286 17 Options.compaction_filter_factory: None
2023/09/26-09:25:26.685286 17 Options.sst_partitioner_factory: None
2023/09/26-09:25:26.685287 17 Options.memtable_factory: SkipListFactory
2023/09/26-09:25:26.685288 17 Options.table_factory: BlockBasedTable
2023/09/26-09:25:26.685304 17 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9133a14160)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x7f9133a25010
block_cache_name: LRUCache
block_cache_options:
capacity : 2502992855
num_shard_bits : 6
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.500
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 65536
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
2023/09/26-09:25:26.685307 17 Options.write_buffer_size: 67108864
2023/09/26-09:25:26.685308 17 Options.max_write_buffer_number: 2
2023/09/26-09:25:26.685309 17 Options.compression[0]: NoCompression
2023/09/26-09:25:26.685309 17 Options.compression[1]: ZSTD
2023/09/26-09:25:26.685310 17 Options.compression[2]: ZSTD
2023/09/26-09:25:26.685311 17 Options.bottommost_compression: Disabled
2023/09/26-09:25:26.685312 17 Options.prefix_extractor: nullptr
2023/09/26-09:25:26.685312 17 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023/09/26-09:25:26.685313 17 Options.num_levels: 3
2023/09/26-09:25:26.685314 17 Options.min_write_buffer_number_to_merge: 1
2023/09/26-09:25:26.685314 17 Options.max_write_buffer_number_to_maintain: 0
2023/09/26-09:25:26.685315 17 Options.max_write_buffer_size_to_maintain: 0
2023/09/26-09:25:26.685316 17 Options.bottommost_compression_opts.window_bits: -14
2023/09/26-09:25:26.685316 17 Options.bottommost_compression_opts.level: 32767
2023/09/26-09:25:26.685317 17 Options.bottommost_compression_opts.strategy: 0
2023/09/26-09:25:26.685318 17 Options.bottommost_compression_opts.max_dict_bytes: 0
2023/09/26-09:25:26.685318 17 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023/09/26-09:25:26.685319 17 Options.bottommost_compression_opts.parallel_threads: 1
2023/09/26-09:25:26.685320 17 Options.bottommost_compression_opts.enabled: false
2023/09/26-09:25:26.685320 17 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2023/09/26-09:25:26.685321 17 Options.compression_opts.window_bits: -14
2023/09/26-09:25:26.685322 17 Options.compression_opts.level: 32767
2023/09/26-09:25:26.685322 17 Options.compression_opts.strategy: 0
2023/09/26-09:25:26.685323 17 Options.compression_opts.max_dict_bytes: 0
2023/09/26-09:25:26.685324 17 Options.compression_opts.zstd_max_train_bytes: 0
2023/09/26-09:25:26.685324 17 Options.compression_opts.parallel_threads: 1
2023/09/26-09:25:26.685325 17 Options.compression_opts.enabled: false
2023/09/26-09:25:26.685325 17 Options.compression_opts.max_dict_buffer_bytes: 0
2023/09/26-09:25:26.685330 17 Options.level0_file_num_compaction_trigger: 4
2023/09/26-09:25:26.685331 17 Options.level0_slowdown_writes_trigger: 20
2023/09/26-09:25:26.685332 17 Options.level0_stop_writes_trigger: 36
2023/09/26-09:25:26.685332 17 Options.target_file_size_base: 67108864
2023/09/26-09:25:26.685333 17 Options.target_file_size_multiplier: 2
2023/09/26-09:25:26.685334 17 Options.max_bytes_for_level_base: 268435456
2023/09/26-09:25:26.685334 17 Options.level_compaction_dynamic_level_bytes: 0
2023/09/26-09:25:26.685335 17 Options.max_bytes_for_level_multiplier: 10.000000
2023/09/26-09:25:26.685337 17 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023/09/26-09:25:26.685337 17 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023/09/26-09:25:26.685338 17 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023/09/26-09:25:26.685339 17 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023/09/26-09:25:26.685339 17 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023/09/26-09:25:26.685340 17 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023/09/26-09:25:26.685341 17 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023/09/26-09:25:26.685341 17 Options.max_sequential_skip_in_iterations: 8
2023/09/26-09:25:26.685342 17 Options.max_compaction_bytes: 1677721600
2023/09/26-09:25:26.685343 17 Options.arena_block_size: 1048576
2023/09/26-09:25:26.685343 17 Options.soft_pending_compaction_bytes_limit: 68719476736
2023/09/26-09:25:26.685344 17 Options.hard_pending_compaction_bytes_limit: 274877906944
2023/09/26-09:25:26.685345 17 Options.rate_limit_delay_max_milliseconds: 100
2023/09/26-09:25:26.685345 17 Options.disable_auto_compactions: 0
2023/09/26-09:25:26.685347 17 Options.compaction_style: kCompactionStyleLevel
2023/09/26-09:25:26.685348 17 Options.compaction_pri: kMinOverlappingRatio
2023/09/26-09:25:26.685348 17 Options.compaction_options_universal.size_ratio: 1
2023/09/26-09:25:26.685349 17 Options.compaction_options_universal.min_merge_width: 2
2023/09/26-09:25:26.685350 17 Options.compaction_options_universal.max_merge_width: 4294967295
2023/09/26-09:25:26.685350 17 Options.compaction_options_universal.max_size_amplification_percent: 200
2023/09/26-09:25:26.685351 17 Options.compaction_options_universal.compression_size_percent: -1
2023/09/26-09:25:26.685352 17 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023/09/26-09:25:26.685352 17 Options.compaction_options_fifo.max_table_files_size: 1073741824
2023/09/26-09:25:26.685353 17 Options.compaction_options_fifo.allow_compaction: 0
2023/09/26-09:25:26.685355 17 Options.table_properties_collectors:
2023/09/26-09:25:26.685356 17 Options.inplace_update_support: 0
2023/09/26-09:25:26.685356 17 Options.inplace_update_num_locks: 10000
2023/09/26-09:25:26.685357 17 Options.memtable_prefix_bloom_size_ratio: 0.000000
2023/09/26-09:25:26.685358 17 Options.memtable_whole_key_filtering: 0
2023/09/26-09:25:26.685358 17 Options.memtable_huge_page_size: 0
2023/09/26-09:25:26.685359 17 Options.bloom_locality: 0
2023/09/26-09:25:26.685360 17 Options.max_successive_merges: 0
2023/09/26-09:25:26.685360 17 Options.optimize_filters_for_hits: 0
2023/09/26-09:25:26.685361 17 Options.paranoid_file_checks: 0
2023/09/26-09:25:26.685362 17 Options.force_consistency_checks: 1
2023/09/26-09:25:26.685362 17 Options.report_bg_io_stats: 0
2023/09/26-09:25:26.685363 17 Options.ttl: 2592000
2023/09/26-09:25:26.685364 17 Options.periodic_compaction_seconds: 0
2023/09/26-09:25:26.685364 17 Options.enable_blob_files: false
2023/09/26-09:25:26.685365 17 Options.min_blob_size: 0
2023/09/26-09:25:26.685368 17 Options.blob_file_size: 268435456
2023/09/26-09:25:26.685369 17 Options.blob_compression_type: NoCompression
2023/09/26-09:25:26.685369 17 Options.enable_blob_garbage_collection: false
2023/09/26-09:25:26.685370 17 Options.blob_garbage_collection_age_cutoff: 0.250000
2023/09/26-09:25:26.685371 17 Options.blob_garbage_collection_force_threshold: 1.000000
2023/09/26-09:25:26.685372 17 Options.blob_compaction_readahead_size: 0
2023/09/26-09:25:26.686196 17 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data_meta_kv/MANIFEST-000004 succeeded,manifest_file_number is 4, next_file_number is 6, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023/09/26-09:25:26.686201 17 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 0
2023/09/26-09:25:26.686251 17 [db/version_set.cc:4384] Creating manifest 8
2023/09/26-09:25:26.690221 17 EVENT_LOG_v1 {"time_micros": 1695720326690213, "job": 1, "event": "recovery_started", "wal_files": [5]}
2023/09/26-09:25:26.690225 17 [db/db_impl/db_impl_open.cc:883] Recovering log #5 mode 2
2023/09/26-09:25:26.691812 17 EVENT_LOG_v1 {"time_micros": 1695720326691796, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 9, "file_size": 1839, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 872, "index_size": 49, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 1528, "raw_average_key_size": 41, "raw_value_size": 214, "raw_average_value_size": 5, "num_data_blocks": 1, "num_entries": 37, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695720326, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf0fe53a-7182-458f-baa9-e07d3ffe5860", "db_session_id": "6O2QNLLK9Q04IJ9PYGWV", "orig_file_number": 9}}
2023/09/26-09:25:26.691837 17 [db/version_set.cc:4384] Creating manifest 10
2023/09/26-09:25:26.695848 17 EVENT_LOG_v1 {"time_micros": 1695720326695845, "job": 1, "event": "recovery_finished"}
2023/09/26-09:25:26.699163 17 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data_meta_kv/000005.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
2023/09/26-09:25:26.699226 17 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9133a5b000
2023/09/26-09:25:26.699252 17 DB pointer 0x7f9133a46000
2023/09/26-09:25:26.699517 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:25:26.699527 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 0.0 total, 0.0 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 0.0 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 1 last_copies: 0 last_secs: 3.4e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-09:35:26.699700 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:35:26.699721 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 600.0 total, 600.0 interval
Cumulative writes: 4247 writes, 4248 keys, 4247 commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 4247 writes, 0 syncs, 4247.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 4247 writes, 4248 keys, 4247 commit groups, 1.0 writes per commit group, ingest: 0.23 MB, 0.00 MB/s
Interval WAL: 4247 writes, 0 syncs, 4247.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 600.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 2 last_copies: 0 last_secs: 4.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-09:45:26.700102 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:45:26.700171 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1200.0 total, 600.0 interval
Cumulative writes: 11K writes, 11K keys, 11K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 11K writes, 0 syncs, 11442.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7195 writes, 7195 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
Interval WAL: 7195 writes, 0 syncs, 7195.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1200.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 3 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-09:55:26.700345 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-09:55:26.700375 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1800.0 total, 600.0 interval
Cumulative writes: 18K writes, 18K keys, 18K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 18K writes, 0 syncs, 18640.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7198 writes, 7198 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1800.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 4 last_copies: 0 last_secs: 3.5e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:05:26.700585 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:05:26.700609 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 2400.0 total, 600.0 interval
Cumulative writes: 25K writes, 25K keys, 25K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 25K writes, 0 syncs, 25836.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7196 writes, 7196 keys, 7196 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7196 writes, 0 syncs, 7196.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 2400.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 5 last_copies: 0 last_secs: 3.4e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:15:26.700962 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:15:26.701033 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3000.0 total, 600.0 interval
Cumulative writes: 33K writes, 33K keys, 33K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 33K writes, 0 syncs, 33035.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7199 writes, 7199 keys, 7199 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3000.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 6 last_copies: 0 last_secs: 9.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:25:26.701396 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:25:26.701466 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3600.0 total, 600.0 interval
Cumulative writes: 40K writes, 40K keys, 40K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 40K writes, 0 syncs, 40235.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3600.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 7 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:35:26.701836 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:35:26.701904 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 4200.0 total, 600.0 interval
Cumulative writes: 47K writes, 47K keys, 47K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 47K writes, 0 syncs, 47434.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7199 writes, 7199 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7199 writes, 0 syncs, 7199.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 4200.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 8 last_copies: 0 last_secs: 8.9e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:45:26.702269 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:45:26.702338 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 4800.0 total, 600.0 interval
Cumulative writes: 54K writes, 54K keys, 54K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 54K writes, 0 syncs, 54632.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7198 writes, 7198 keys, 7195 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7198 writes, 0 syncs, 7198.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 4800.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 9 last_copies: 0 last_secs: 9e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-10:55:26.702526 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-10:55:26.702554 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 5400.0 total, 600.0 interval
Cumulative writes: 61K writes, 61K keys, 61K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 61K writes, 0 syncs, 61832.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7198 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 5400.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 10 last_copies: 0 last_secs: 4.3e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:05:26.702919 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:05:26.703004 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 6000.0 total, 600.0 interval
Cumulative writes: 69K writes, 69K keys, 69K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 69K writes, 0 syncs, 69032.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7200 writes, 7200 keys, 7199 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7200 writes, 0 syncs, 7200.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 6000.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 11 last_copies: 0 last_secs: 8.9e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:15:26.703189 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:15:26.703225 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 6600.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 3373 writes, 3373 keys, 3372 commit groups, 1.0 writes per commit group, ingest: 0.19 MB, 0.00 MB/s
Interval WAL: 3373 writes, 0 syncs, 3373.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 6600.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 12 last_copies: 0 last_secs: 3.6e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:25:26.703594 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:25:26.703671 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 7200.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 7200.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 13 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:35:26.703985 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:35:26.704044 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 7800.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 7800.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 14 last_copies: 0 last_secs: 7.7e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:45:26.704427 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:45:26.704498 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 8400.0 total, 600.0 interval
Cumulative writes: 72K writes, 72K keys, 72K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 72K writes, 0 syncs, 72405.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 1.80 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Sum 1/0 1.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.002 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 8400.0 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9133a25010#7 capacity: 2.33 GB collections: 15 last_copies: 0 last_secs: 9.6e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(2,7.03 KB,0.000287656%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-11:54:32.182086 7 [db/db_impl/db_impl.cc:472] Shutdown: canceling all background work
2023/09/26-11:54:32.182303 7 [db/db_impl/db_impl.cc:685] Shutdown complete

View File

@ -0,0 +1,509 @@
2023/09/26-11:55:44.006969 16 RocksDB version: 6.27.3
2023/09/26-11:55:44.007031 16 Git sha 0
2023/09/26-11:55:44.007034 16 Compile date 2023-06-14 04:09:40
2023/09/26-11:55:44.007038 16 DB SUMMARY
2023/09/26-11:55:44.007039 16 DB Session ID: LDJPBRCKW95VBBDOA0BC
2023/09/26-11:55:44.007064 16 CURRENT file: CURRENT
2023/09/26-11:55:44.007066 16 IDENTITY file: IDENTITY
2023/09/26-11:55:44.007071 16 MANIFEST file: MANIFEST-000010 size: 185 Bytes
2023/09/26-11:55:44.007073 16 SST files in /var/lib/milvus/rdb_data_meta_kv dir, Total Num: 1, files: 000009.sst
2023/09/26-11:55:44.007075 16 Write Ahead Log file in /var/lib/milvus/rdb_data_meta_kv: 000011.log size: 4800444 ;
2023/09/26-11:55:44.007077 16 Options.error_if_exists: 0
2023/09/26-11:55:44.007079 16 Options.create_if_missing: 1
2023/09/26-11:55:44.007080 16 Options.paranoid_checks: 1
2023/09/26-11:55:44.007081 16 Options.flush_verify_memtable_count: 1
2023/09/26-11:55:44.007083 16 Options.track_and_verify_wals_in_manifest: 0
2023/09/26-11:55:44.007084 16 Options.env: 0x5e1d140
2023/09/26-11:55:44.007086 16 Options.fs: PosixFileSystem
2023/09/26-11:55:44.007088 16 Options.info_log: 0x7f9f31e4e050
2023/09/26-11:55:44.007089 16 Options.max_file_opening_threads: 16
2023/09/26-11:55:44.007091 16 Options.statistics: (nil)
2023/09/26-11:55:44.007093 16 Options.use_fsync: 0
2023/09/26-11:55:44.007094 16 Options.max_log_file_size: 0
2023/09/26-11:55:44.007095 16 Options.max_manifest_file_size: 1073741824
2023/09/26-11:55:44.007097 16 Options.log_file_time_to_roll: 0
2023/09/26-11:55:44.007098 16 Options.keep_log_file_num: 1000
2023/09/26-11:55:44.007100 16 Options.recycle_log_file_num: 0
2023/09/26-11:55:44.007101 16 Options.allow_fallocate: 1
2023/09/26-11:55:44.007102 16 Options.allow_mmap_reads: 0
2023/09/26-11:55:44.007104 16 Options.allow_mmap_writes: 0
2023/09/26-11:55:44.007105 16 Options.use_direct_reads: 0
2023/09/26-11:55:44.007106 16 Options.use_direct_io_for_flush_and_compaction: 0
2023/09/26-11:55:44.007108 16 Options.create_missing_column_families: 0
2023/09/26-11:55:44.007109 16 Options.db_log_dir:
2023/09/26-11:55:44.007111 16 Options.wal_dir:
2023/09/26-11:55:44.007112 16 Options.table_cache_numshardbits: 6
2023/09/26-11:55:44.007114 16 Options.WAL_ttl_seconds: 0
2023/09/26-11:55:44.007115 16 Options.WAL_size_limit_MB: 0
2023/09/26-11:55:44.007116 16 Options.max_write_batch_group_size_bytes: 1048576
2023/09/26-11:55:44.007118 16 Options.manifest_preallocation_size: 4194304
2023/09/26-11:55:44.007119 16 Options.is_fd_close_on_exec: 1
2023/09/26-11:55:44.007120 16 Options.advise_random_on_open: 1
2023/09/26-11:55:44.007122 16 Options.experimental_mempurge_threshold: 0.000000
2023/09/26-11:55:44.007130 16 Options.db_write_buffer_size: 0
2023/09/26-11:55:44.007131 16 Options.write_buffer_manager: 0x7f9f31e0a0a0
2023/09/26-11:55:44.007133 16 Options.access_hint_on_compaction_start: 1
2023/09/26-11:55:44.007134 16 Options.new_table_reader_for_compaction_inputs: 0
2023/09/26-11:55:44.007136 16 Options.random_access_max_buffer_size: 1048576
2023/09/26-11:55:44.007137 16 Options.use_adaptive_mutex: 0
2023/09/26-11:55:44.007138 16 Options.rate_limiter: (nil)
2023/09/26-11:55:44.007140 16 Options.sst_file_manager.rate_bytes_per_sec: 0
2023/09/26-11:55:44.007142 16 Options.wal_recovery_mode: 2
2023/09/26-11:55:44.007149 16 Options.enable_thread_tracking: 0
2023/09/26-11:55:44.007151 16 Options.enable_pipelined_write: 0
2023/09/26-11:55:44.007152 16 Options.unordered_write: 0
2023/09/26-11:55:44.007153 16 Options.allow_concurrent_memtable_write: 1
2023/09/26-11:55:44.007154 16 Options.enable_write_thread_adaptive_yield: 1
2023/09/26-11:55:44.007156 16 Options.write_thread_max_yield_usec: 100
2023/09/26-11:55:44.007157 16 Options.write_thread_slow_yield_usec: 3
2023/09/26-11:55:44.007159 16 Options.row_cache: None
2023/09/26-11:55:44.007160 16 Options.wal_filter: None
2023/09/26-11:55:44.007247 16 Options.avoid_flush_during_recovery: 0
2023/09/26-11:55:44.007249 16 Options.allow_ingest_behind: 0
2023/09/26-11:55:44.007250 16 Options.preserve_deletes: 0
2023/09/26-11:55:44.007251 16 Options.two_write_queues: 0
2023/09/26-11:55:44.007252 16 Options.manual_wal_flush: 0
2023/09/26-11:55:44.007253 16 Options.atomic_flush: 0
2023/09/26-11:55:44.007254 16 Options.avoid_unnecessary_blocking_io: 0
2023/09/26-11:55:44.007255 16 Options.persist_stats_to_disk: 0
2023/09/26-11:55:44.007256 16 Options.write_dbid_to_manifest: 0
2023/09/26-11:55:44.007258 16 Options.log_readahead_size: 0
2023/09/26-11:55:44.007259 16 Options.file_checksum_gen_factory: Unknown
2023/09/26-11:55:44.007260 16 Options.best_efforts_recovery: 0
2023/09/26-11:55:44.007262 16 Options.max_bgerror_resume_count: 2147483647
2023/09/26-11:55:44.007263 16 Options.bgerror_resume_retry_interval: 1000000
2023/09/26-11:55:44.007265 16 Options.allow_data_in_errors: 0
2023/09/26-11:55:44.007266 16 Options.db_host_id: __hostname__
2023/09/26-11:55:44.007267 16 Options.max_background_jobs: 1
2023/09/26-11:55:44.007269 16 Options.max_background_compactions: -1
2023/09/26-11:55:44.007270 16 Options.max_subcompactions: 1
2023/09/26-11:55:44.007272 16 Options.avoid_flush_during_shutdown: 0
2023/09/26-11:55:44.007273 16 Options.writable_file_max_buffer_size: 1048576
2023/09/26-11:55:44.007274 16 Options.delayed_write_rate : 16777216
2023/09/26-11:55:44.007276 16 Options.max_total_wal_size: 0
2023/09/26-11:55:44.007277 16 Options.delete_obsolete_files_period_micros: 21600000000
2023/09/26-11:55:44.007278 16 Options.stats_dump_period_sec: 600
2023/09/26-11:55:44.007280 16 Options.stats_persist_period_sec: 600
2023/09/26-11:55:44.007281 16 Options.stats_history_buffer_size: 1048576
2023/09/26-11:55:44.007283 16 Options.max_open_files: -1
2023/09/26-11:55:44.007284 16 Options.bytes_per_sync: 0
2023/09/26-11:55:44.007285 16 Options.wal_bytes_per_sync: 0
2023/09/26-11:55:44.007287 16 Options.strict_bytes_per_sync: 0
2023/09/26-11:55:44.007288 16 Options.compaction_readahead_size: 0
2023/09/26-11:55:44.007290 16 Options.max_background_flushes: 1
2023/09/26-11:55:44.007291 16 Compression algorithms supported:
2023/09/26-11:55:44.007292 16 kZSTDNotFinalCompression supported: 1
2023/09/26-11:55:44.007295 16 kZSTD supported: 1
2023/09/26-11:55:44.007296 16 kXpressCompression supported: 0
2023/09/26-11:55:44.007298 16 kLZ4HCCompression supported: 0
2023/09/26-11:55:44.007299 16 kLZ4Compression supported: 0
2023/09/26-11:55:44.007301 16 kBZip2Compression supported: 0
2023/09/26-11:55:44.007302 16 kZlibCompression supported: 0
2023/09/26-11:55:44.007303 16 kSnappyCompression supported: 0
2023/09/26-11:55:44.007306 16 Fast CRC32 supported: Supported on x86
2023/09/26-11:55:44.007362 16 [db/version_set.cc:4846] Recovering from manifest file: /var/lib/milvus/rdb_data_meta_kv/MANIFEST-000010
2023/09/26-11:55:44.007523 16 [db/column_family.cc:605] --------------- Options for column family [default]:
2023/09/26-11:55:44.007526 16 Options.comparator: leveldb.BytewiseComparator
2023/09/26-11:55:44.007528 16 Options.merge_operator: None
2023/09/26-11:55:44.007529 16 Options.compaction_filter: None
2023/09/26-11:55:44.007531 16 Options.compaction_filter_factory: None
2023/09/26-11:55:44.007532 16 Options.sst_partitioner_factory: None
2023/09/26-11:55:44.007534 16 Options.memtable_factory: SkipListFactory
2023/09/26-11:55:44.007536 16 Options.table_factory: BlockBasedTable
2023/09/26-11:55:44.007562 16 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f9f31e000e0)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x7f9f31e0a010
block_cache_name: LRUCache
block_cache_options:
capacity : 2502992855
num_shard_bits : 6
strict_capacity_limit : 0
memory_allocator : None
high_pri_pool_ratio: 0.500
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 65536
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: nullptr
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
2023/09/26-11:55:44.007566 16 Options.write_buffer_size: 67108864
2023/09/26-11:55:44.007568 16 Options.max_write_buffer_number: 2
2023/09/26-11:55:44.007569 16 Options.compression[0]: NoCompression
2023/09/26-11:55:44.007571 16 Options.compression[1]: ZSTD
2023/09/26-11:55:44.007572 16 Options.compression[2]: ZSTD
2023/09/26-11:55:44.007574 16 Options.bottommost_compression: Disabled
2023/09/26-11:55:44.007575 16 Options.prefix_extractor: nullptr
2023/09/26-11:55:44.007577 16 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2023/09/26-11:55:44.007578 16 Options.num_levels: 3
2023/09/26-11:55:44.007580 16 Options.min_write_buffer_number_to_merge: 1
2023/09/26-11:55:44.007581 16 Options.max_write_buffer_number_to_maintain: 0
2023/09/26-11:55:44.007583 16 Options.max_write_buffer_size_to_maintain: 0
2023/09/26-11:55:44.007584 16 Options.bottommost_compression_opts.window_bits: -14
2023/09/26-11:55:44.007585 16 Options.bottommost_compression_opts.level: 32767
2023/09/26-11:55:44.007587 16 Options.bottommost_compression_opts.strategy: 0
2023/09/26-11:55:44.007588 16 Options.bottommost_compression_opts.max_dict_bytes: 0
2023/09/26-11:55:44.007590 16 Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2023/09/26-11:55:44.007591 16 Options.bottommost_compression_opts.parallel_threads: 1
2023/09/26-11:55:44.007592 16 Options.bottommost_compression_opts.enabled: false
2023/09/26-11:55:44.007594 16 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
2023/09/26-11:55:44.007595 16 Options.compression_opts.window_bits: -14
2023/09/26-11:55:44.007597 16 Options.compression_opts.level: 32767
2023/09/26-11:55:44.007598 16 Options.compression_opts.strategy: 0
2023/09/26-11:55:44.007600 16 Options.compression_opts.max_dict_bytes: 0
2023/09/26-11:55:44.007601 16 Options.compression_opts.zstd_max_train_bytes: 0
2023/09/26-11:55:44.007602 16 Options.compression_opts.parallel_threads: 1
2023/09/26-11:55:44.007604 16 Options.compression_opts.enabled: false
2023/09/26-11:55:44.007610 16 Options.compression_opts.max_dict_buffer_bytes: 0
2023/09/26-11:55:44.007612 16 Options.level0_file_num_compaction_trigger: 4
2023/09/26-11:55:44.007613 16 Options.level0_slowdown_writes_trigger: 20
2023/09/26-11:55:44.007615 16 Options.level0_stop_writes_trigger: 36
2023/09/26-11:55:44.007616 16 Options.target_file_size_base: 67108864
2023/09/26-11:55:44.007617 16 Options.target_file_size_multiplier: 2
2023/09/26-11:55:44.007619 16 Options.max_bytes_for_level_base: 268435456
2023/09/26-11:55:44.007620 16 Options.level_compaction_dynamic_level_bytes: 0
2023/09/26-11:55:44.007622 16 Options.max_bytes_for_level_multiplier: 10.000000
2023/09/26-11:55:44.007624 16 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2023/09/26-11:55:44.007626 16 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2023/09/26-11:55:44.007627 16 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2023/09/26-11:55:44.007629 16 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2023/09/26-11:55:44.007630 16 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2023/09/26-11:55:44.007632 16 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2023/09/26-11:55:44.007633 16 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2023/09/26-11:55:44.007635 16 Options.max_sequential_skip_in_iterations: 8
2023/09/26-11:55:44.007636 16 Options.max_compaction_bytes: 1677721600
2023/09/26-11:55:44.007637 16 Options.arena_block_size: 1048576
2023/09/26-11:55:44.007639 16 Options.soft_pending_compaction_bytes_limit: 68719476736
2023/09/26-11:55:44.007640 16 Options.hard_pending_compaction_bytes_limit: 274877906944
2023/09/26-11:55:44.007642 16 Options.rate_limit_delay_max_milliseconds: 100
2023/09/26-11:55:44.007643 16 Options.disable_auto_compactions: 0
2023/09/26-11:55:44.007645 16 Options.compaction_style: kCompactionStyleLevel
2023/09/26-11:55:44.007647 16 Options.compaction_pri: kMinOverlappingRatio
2023/09/26-11:55:44.007649 16 Options.compaction_options_universal.size_ratio: 1
2023/09/26-11:55:44.007650 16 Options.compaction_options_universal.min_merge_width: 2
2023/09/26-11:55:44.007652 16 Options.compaction_options_universal.max_merge_width: 4294967295
2023/09/26-11:55:44.007653 16 Options.compaction_options_universal.max_size_amplification_percent: 200
2023/09/26-11:55:44.007654 16 Options.compaction_options_universal.compression_size_percent: -1
2023/09/26-11:55:44.007656 16 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2023/09/26-11:55:44.007657 16 Options.compaction_options_fifo.max_table_files_size: 1073741824
2023/09/26-11:55:44.007659 16 Options.compaction_options_fifo.allow_compaction: 0
2023/09/26-11:55:44.007662 16 Options.table_properties_collectors:
2023/09/26-11:55:44.007664 16 Options.inplace_update_support: 0
2023/09/26-11:55:44.007665 16 Options.inplace_update_num_locks: 10000
2023/09/26-11:55:44.007666 16 Options.memtable_prefix_bloom_size_ratio: 0.000000
2023/09/26-11:55:44.007668 16 Options.memtable_whole_key_filtering: 0
2023/09/26-11:55:44.007670 16 Options.memtable_huge_page_size: 0
2023/09/26-11:55:44.007671 16 Options.bloom_locality: 0
2023/09/26-11:55:44.007672 16 Options.max_successive_merges: 0
2023/09/26-11:55:44.007674 16 Options.optimize_filters_for_hits: 0
2023/09/26-11:55:44.007675 16 Options.paranoid_file_checks: 0
2023/09/26-11:55:44.007677 16 Options.force_consistency_checks: 1
2023/09/26-11:55:44.007678 16 Options.report_bg_io_stats: 0
2023/09/26-11:55:44.007679 16 Options.ttl: 2592000
2023/09/26-11:55:44.007681 16 Options.periodic_compaction_seconds: 0
2023/09/26-11:55:44.007682 16 Options.enable_blob_files: false
2023/09/26-11:55:44.007687 16 Options.min_blob_size: 0
2023/09/26-11:55:44.007687 16 Options.blob_file_size: 268435456
2023/09/26-11:55:44.007688 16 Options.blob_compression_type: NoCompression
2023/09/26-11:55:44.007689 16 Options.enable_blob_garbage_collection: false
2023/09/26-11:55:44.007691 16 Options.blob_garbage_collection_age_cutoff: 0.250000
2023/09/26-11:55:44.007693 16 Options.blob_garbage_collection_force_threshold: 1.000000
2023/09/26-11:55:44.007694 16 Options.blob_compaction_readahead_size: 0
2023/09/26-11:55:44.008806 16 [db/version_set.cc:4886] Recovered from manifest file:/var/lib/milvus/rdb_data_meta_kv/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 161, log_number is 6,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2023/09/26-11:55:44.008811 16 [db/version_set.cc:4901] Column family [default] (ID 0), log number is 6
2023/09/26-11:55:44.008866 16 [db/version_set.cc:4384] Creating manifest 14
2023/09/26-11:55:44.013008 16 EVENT_LOG_v1 {"time_micros": 1695729344013000, "job": 1, "event": "recovery_started", "wal_files": [11]}
2023/09/26-11:55:44.013012 16 [db/db_impl/db_impl_open.cc:883] Recovering log #11 mode 2
2023/09/26-11:55:44.072119 16 EVENT_LOG_v1 {"time_micros": 1695729344072083, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 15, "file_size": 1217, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 249, "index_size": 51, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 285, "raw_average_key_size": 40, "raw_value_size": 51, "raw_average_value_size": 7, "num_data_blocks": 1, "num_entries": 7, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1695729344, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf0fe53a-7182-458f-baa9-e07d3ffe5860", "db_session_id": "LDJPBRCKW95VBBDOA0BC", "orig_file_number": 15}}
2023/09/26-11:55:44.072163 16 [db/version_set.cc:4384] Creating manifest 16
2023/09/26-11:55:44.076244 16 EVENT_LOG_v1 {"time_micros": 1695729344076241, "job": 1, "event": "recovery_finished"}
2023/09/26-11:55:44.080851 16 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data_meta_kv/000011.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000
2023/09/26-11:55:44.080869 16 [db/db_impl/db_impl_open.cc:1792] SstFileManager instance 0x7f9f31e55000
2023/09/26-11:55:44.080900 16 DB pointer 0x7f9f31e39000
2023/09/26-11:55:44.081157 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-11:55:44.081167 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 0.1 total, 0.1 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 0.1 total, 0.1 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 1 last_copies: 0 last_secs: 3.6e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:05:44.081406 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:05:44.081455 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 600.1 total, 600.0 interval
Cumulative writes: 6953 writes, 6953 keys, 6953 commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 6953 writes, 0 syncs, 6953.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 6953 writes, 6953 keys, 6953 commit groups, 1.0 writes per commit group, ingest: 0.39 MB, 0.00 MB/s
Interval WAL: 6953 writes, 0 syncs, 6953.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 600.1 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 2 last_copies: 0 last_secs: 4.8e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:15:44.081714 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:15:44.081747 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1200.1 total, 600.0 interval
Cumulative writes: 14K writes, 14K keys, 14K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 14K writes, 0 syncs, 14077.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7124 writes, 7124 keys, 7124 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1200.1 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 3 last_copies: 0 last_secs: 5.7e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:25:44.081938 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:25:44.081971 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 1800.1 total, 600.0 interval
Cumulative writes: 21K writes, 21K keys, 21K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 21K writes, 0 syncs, 21187.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7110 writes, 7110 keys, 7110 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
Interval WAL: 7110 writes, 0 syncs, 7110.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 1800.1 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 4 last_copies: 0 last_secs: 4e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:35:44.082170 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:35:44.082210 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 2400.1 total, 600.0 interval
Cumulative writes: 28K writes, 28K keys, 28K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 28K writes, 0 syncs, 28311.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7124 writes, 7124 keys, 7124 commit groups, 1.0 writes per commit group, ingest: 0.41 MB, 0.00 MB/s
Interval WAL: 7124 writes, 0 syncs, 7124.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 2400.1 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 5 last_copies: 0 last_secs: 4.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:45:44.082582 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:45:44.082653 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3000.1 total, 600.0 interval
Cumulative writes: 35K writes, 35K keys, 35K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 35K writes, 0 syncs, 35425.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7114 writes, 7114 keys, 7114 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
Interval WAL: 7114 writes, 0 syncs, 7114.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3000.1 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 6 last_copies: 0 last_secs: 9.4e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
2023/09/26-12:55:44.083022 36 [db/db_impl/db_impl.cc:1004] ------- DUMPING STATS -------
2023/09/26-12:55:44.083094 36 [db/db_impl/db_impl.cc:1006]
** DB Stats **
Uptime(secs): 3600.1 total, 600.0 interval
Cumulative writes: 42K writes, 42K keys, 42K commit groups, 1.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 42K writes, 0 syncs, 42513.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 7088 writes, 7088 keys, 7085 commit groups, 1.0 writes per commit group, ingest: 0.40 MB, 0.00 MB/s
Interval WAL: 7088 writes, 0 syncs, 7088.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 2.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Sum 2/0 2.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.01 0.00 1 0.008 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB
Uptime(secs): 3600.1 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f9f31e0a010#7 capacity: 2.33 GB collections: 7 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(5,6.07 MB,0.254283%) Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **

Binary file not shown.

View File

@ -0,0 +1,190 @@
# This is a RocksDB option file.
#
# For detailed file format spec, please refer to the example file
# in examples/rocksdb_option_file_example.ini
#
[Version]
rocksdb_version=6.27.3
options_file_version=1.1
[DBOptions]
max_open_files=-1
stats_history_buffer_size=1048576
stats_persist_period_sec=600
max_background_flushes=1
stats_dump_period_sec=600
compaction_readahead_size=0
bytes_per_sync=0
delete_obsolete_files_period_micros=21600000000
max_total_wal_size=0
delayed_write_rate=16777216
wal_bytes_per_sync=0
writable_file_max_buffer_size=1048576
avoid_flush_during_shutdown=false
max_subcompactions=1
strict_bytes_per_sync=false
max_background_compactions=-1
base_background_compactions=-1
max_background_jobs=1
file_checksum_gen_factory=nullptr
db_host_id=__hostname__
bgerror_resume_retry_interval=1000000
best_efforts_recovery=false
avoid_unnecessary_blocking_io=false
two_write_queues=false
atomic_flush=false
preserve_deletes=false
allow_ingest_behind=false
lowest_used_cache_tier=kNonVolatileBlockTier
avoid_flush_during_recovery=false
info_log_level=INFO_LEVEL
access_hint_on_compaction_start=NORMAL
max_bgerror_resume_count=2147483647
write_thread_slow_yield_usec=3
allow_concurrent_memtable_write=true
WAL_ttl_seconds=0
manual_wal_flush=false
dump_malloc_stats=false
wal_recovery_mode=kPointInTimeRecovery
log_file_time_to_roll=0
enable_write_thread_adaptive_yield=true
recycle_log_file_num=0
table_cache_numshardbits=6
max_file_opening_threads=16
allow_data_in_errors=false
use_fsync=false
unordered_write=false
fail_if_options_file_error=false
random_access_max_buffer_size=1048576
new_table_reader_for_compaction_inputs=false
skip_checking_sst_file_sizes_on_db_open=false
skip_stats_update_on_db_open=false
persist_stats_to_disk=false
track_and_verify_wals_in_manifest=false
enable_pipelined_write=false
flush_verify_memtable_count=true
log_readahead_size=0
is_fd_close_on_exec=true
WAL_size_limit_MB=0
experimental_mempurge_threshold=0.000000
write_dbid_to_manifest=false
use_adaptive_mutex=false
error_if_exists=false
write_thread_max_yield_usec=100
enable_thread_tracking=false
db_write_buffer_size=0
create_missing_column_families=false
paranoid_checks=true
create_if_missing=true
wal_filter=nullptr
max_manifest_file_size=1073741824
allow_2pc=false
use_direct_io_for_flush_and_compaction=false
manifest_preallocation_size=4194304
use_direct_reads=false
allow_fallocate=true
max_write_batch_group_size_bytes=1048576
keep_log_file_num=1000
allow_mmap_reads=false
max_log_file_size=0
allow_mmap_writes=false
advise_random_on_open=true
[CFOptions "default"]
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
bottommost_compression=kDisableCompressionOption
enable_blob_garbage_collection=false
blob_file_size=268435456
sample_for_compression=0
periodic_compaction_seconds=0
ttl=2592000
blob_garbage_collection_age_cutoff=0.250000
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
compression=kNoCompression
max_sequential_skip_in_iterations=8
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
max_bytes_for_level_multiplier=10.000000
max_bytes_for_level_base=268435456
memtable_whole_key_filtering=false
max_successive_merges=0
blob_compaction_readahead_size=0
inplace_update_num_locks=10000
arena_block_size=1048576
target_file_size_multiplier=2
prefix_extractor=nullptr
max_write_buffer_number=2
blob_compression_type=kNoCompression
level0_stop_writes_trigger=36
level0_slowdown_writes_trigger=20
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
level0_file_num_compaction_trigger=4
write_buffer_size=67108864
memtable_huge_page_size=0
max_compaction_bytes=1677721600
min_blob_size=0
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
hard_pending_compaction_bytes_limit=274877906944
target_file_size_base=67108864
soft_pending_compaction_bytes_limit=68719476736
enable_blob_files=false
paranoid_file_checks=false
check_flush_compaction_key_order=true
blob_garbage_collection_force_threshold=1.000000
disable_auto_compactions=false
memtable_prefix_bloom_size_ratio=0.000000
report_bg_io_stats=false
compaction_pri=kMinOverlappingRatio
compaction_filter_factory=nullptr
comparator=leveldb.BytewiseComparator
sst_partitioner_factory=nullptr
bloom_locality=0
compaction_style=kCompactionStyleLevel
min_write_buffer_number_to_merge=1
max_write_buffer_size_to_maintain=0
max_write_buffer_number_to_maintain=0
merge_operator=nullptr
memtable_factory=SkipListFactory
memtable_insert_with_hint_prefix_extractor=nullptr
compression_per_level=kNoCompression:kZSTD:kZSTD
num_levels=3
force_consistency_checks=true
optimize_filters_for_hits=false
compaction_filter=nullptr
level_compaction_dynamic_level_bytes=false
inplace_update_support=false
table_factory=BlockBasedTable
[TableOptions/BlockBasedTable "default"]
pin_top_level_index_and_filter=true
block_align=false
read_amp_bytes_per_bit=0
verify_compression=false
enable_index_compression=true
reserve_table_builder_memory=false
whole_key_filtering=true
max_auto_readahead_size=262144
optimize_filters_for_memory=false
index_block_restart_interval=1
prepopulate_block_cache=kDisable
block_restart_interval=16
block_size=65536
format_version=5
partition_filters=false
block_size_deviation=10
no_block_cache=false
checksum=kCRC32c
data_block_hash_table_util_ratio=0.750000
index_shortening=kShortenSeparators
data_block_index_type=kDataBlockBinarySearch
hash_index_allow_collision=true
filter_policy=nullptr
metadata_block_size=4096
index_type=kBinarySearch
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
pin_l0_filter_and_index_blocks_in_cache=false
cache_index_and_filter_blocks_with_high_priority=true
cache_index_and_filter_blocks=false
flush_block_policy_factory=FlushBlockBySizePolicyFactory

View File

@ -0,0 +1,190 @@
# This is a RocksDB option file.
#
# For detailed file format spec, please refer to the example file
# in examples/rocksdb_option_file_example.ini
#
[Version]
rocksdb_version=6.27.3
options_file_version=1.1
[DBOptions]
max_open_files=-1
stats_history_buffer_size=1048576
stats_persist_period_sec=600
max_background_flushes=1
stats_dump_period_sec=600
compaction_readahead_size=0
bytes_per_sync=0
delete_obsolete_files_period_micros=21600000000
max_total_wal_size=0
delayed_write_rate=16777216
wal_bytes_per_sync=0
writable_file_max_buffer_size=1048576
avoid_flush_during_shutdown=false
max_subcompactions=1
strict_bytes_per_sync=false
max_background_compactions=-1
base_background_compactions=-1
max_background_jobs=1
file_checksum_gen_factory=nullptr
db_host_id=__hostname__
bgerror_resume_retry_interval=1000000
best_efforts_recovery=false
avoid_unnecessary_blocking_io=false
two_write_queues=false
atomic_flush=false
preserve_deletes=false
allow_ingest_behind=false
lowest_used_cache_tier=kNonVolatileBlockTier
avoid_flush_during_recovery=false
info_log_level=INFO_LEVEL
access_hint_on_compaction_start=NORMAL
max_bgerror_resume_count=2147483647
write_thread_slow_yield_usec=3
allow_concurrent_memtable_write=true
WAL_ttl_seconds=0
manual_wal_flush=false
dump_malloc_stats=false
wal_recovery_mode=kPointInTimeRecovery
log_file_time_to_roll=0
enable_write_thread_adaptive_yield=true
recycle_log_file_num=0
table_cache_numshardbits=6
max_file_opening_threads=16
allow_data_in_errors=false
use_fsync=false
unordered_write=false
fail_if_options_file_error=false
random_access_max_buffer_size=1048576
new_table_reader_for_compaction_inputs=false
skip_checking_sst_file_sizes_on_db_open=false
skip_stats_update_on_db_open=false
persist_stats_to_disk=false
track_and_verify_wals_in_manifest=false
enable_pipelined_write=false
flush_verify_memtable_count=true
log_readahead_size=0
is_fd_close_on_exec=true
WAL_size_limit_MB=0
experimental_mempurge_threshold=0.000000
write_dbid_to_manifest=false
use_adaptive_mutex=false
error_if_exists=false
write_thread_max_yield_usec=100
enable_thread_tracking=false
db_write_buffer_size=0
create_missing_column_families=false
paranoid_checks=true
create_if_missing=true
wal_filter=nullptr
max_manifest_file_size=1073741824
allow_2pc=false
use_direct_io_for_flush_and_compaction=false
manifest_preallocation_size=4194304
use_direct_reads=false
allow_fallocate=true
max_write_batch_group_size_bytes=1048576
keep_log_file_num=1000
allow_mmap_reads=false
max_log_file_size=0
allow_mmap_writes=false
advise_random_on_open=true
[CFOptions "default"]
compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
bottommost_compression=kDisableCompressionOption
enable_blob_garbage_collection=false
blob_file_size=268435456
sample_for_compression=0
periodic_compaction_seconds=0
ttl=2592000
blob_garbage_collection_age_cutoff=0.250000
compaction_options_universal={allow_trivial_move=false;incremental=false;stop_style=kCompactionStopStyleTotalSize;compression_size_percent=-1;max_size_amplification_percent=200;max_merge_width=4294967295;min_merge_width=2;size_ratio=1;}
compression=kNoCompression
max_sequential_skip_in_iterations=8
max_bytes_for_level_multiplier_additional=1:1:1:1:1:1:1
max_bytes_for_level_multiplier=10.000000
max_bytes_for_level_base=268435456
memtable_whole_key_filtering=false
max_successive_merges=0
blob_compaction_readahead_size=0
inplace_update_num_locks=10000
arena_block_size=1048576
target_file_size_multiplier=2
prefix_extractor=nullptr
max_write_buffer_number=2
blob_compression_type=kNoCompression
level0_stop_writes_trigger=36
level0_slowdown_writes_trigger=20
compaction_options_fifo={allow_compaction=false;age_for_warm=0;max_table_files_size=1073741824;}
level0_file_num_compaction_trigger=4
write_buffer_size=67108864
memtable_huge_page_size=0
max_compaction_bytes=1677721600
min_blob_size=0
bottommost_compression_opts={max_dict_buffer_bytes=0;enabled=false;parallel_threads=1;zstd_max_train_bytes=0;strategy=0;max_dict_bytes=0;level=32767;window_bits=-14;}
hard_pending_compaction_bytes_limit=274877906944
target_file_size_base=67108864
soft_pending_compaction_bytes_limit=68719476736
enable_blob_files=false
paranoid_file_checks=false
check_flush_compaction_key_order=true
blob_garbage_collection_force_threshold=1.000000
disable_auto_compactions=false
memtable_prefix_bloom_size_ratio=0.000000
report_bg_io_stats=false
compaction_pri=kMinOverlappingRatio
compaction_filter_factory=nullptr
comparator=leveldb.BytewiseComparator
sst_partitioner_factory=nullptr
bloom_locality=0
compaction_style=kCompactionStyleLevel
min_write_buffer_number_to_merge=1
max_write_buffer_size_to_maintain=0
max_write_buffer_number_to_maintain=0
merge_operator=nullptr
memtable_factory=SkipListFactory
memtable_insert_with_hint_prefix_extractor=nullptr
compression_per_level=kNoCompression:kZSTD:kZSTD
num_levels=3
force_consistency_checks=true
optimize_filters_for_hits=false
compaction_filter=nullptr
level_compaction_dynamic_level_bytes=false
inplace_update_support=false
table_factory=BlockBasedTable
[TableOptions/BlockBasedTable "default"]
pin_top_level_index_and_filter=true
block_align=false
read_amp_bytes_per_bit=0
verify_compression=false
enable_index_compression=true
reserve_table_builder_memory=false
whole_key_filtering=true
max_auto_readahead_size=262144
optimize_filters_for_memory=false
index_block_restart_interval=1
prepopulate_block_cache=kDisable
block_restart_interval=16
block_size=65536
format_version=5
partition_filters=false
block_size_deviation=10
no_block_cache=false
checksum=kCRC32c
data_block_hash_table_util_ratio=0.750000
index_shortening=kShortenSeparators
data_block_index_type=kDataBlockBinarySearch
hash_index_allow_collision=true
filter_policy=nullptr
metadata_block_size=4096
index_type=kBinarySearch
metadata_cache_options={unpartitioned_pinning=kFallback;partition_pinning=kFallback;top_level_index_pinning=kFallback;}
pin_l0_filter_and_index_blocks_in_cache=false
cache_index_and_filter_blocks_with_high_priority=true
cache_index_and_filter_blocks=false
flush_block_policy_factory=FlushBlockBySizePolicyFactory

Binary file not shown.

Binary file not shown.

View File

@ -0,0 +1 @@
{"version":"1","format":"xl-single","id":"939dc802-c818-45a8-8ff0-9ed126411381","xl":{"version":"3","this":"92610d0c-4c3f-44d6-afb0-9a46848acc39","sets":[["92610d0c-4c3f-44d6-afb0-9a46848acc39"]],"distributionAlgo":"SIPMOD+PARITY"}}

Binary file not shown.

Some files were not shown because too many files have changed in this diff Show More