From 0b9064d4c403ed52ea550efe6c2f94ee9a989b7a Mon Sep 17 00:00:00 2001
From: joaquintides <joaquin@tid.es>
Date: Wed, 31 May 2023 19:38:07 +0200
Subject: [PATCH] [skip ci] updated README.md

---
 README.md | 88 ++++++++++++++++++++++++++++++++++++++++++++++++++++---
 1 file changed, 84 insertions(+), 4 deletions(-)

diff --git a/README.md b/README.md
index d144b438..fbbdbb1a 100644
--- a/README.md
+++ b/README.md
@@ -1,5 +1,85 @@
-# Boost.Unordered benchmarks
+# `boost::concurrent_flat_map` benchmarks
 
-* [Boost.Unordered aggregate benchmarks](https://github.com/boostorg/boost_unordered_benchmarks/tree/boost_unordered_aggregate)
-* [Running-_n_ benchmarks, `boost::unordered_[multi]set`](https://github.com/boostorg/boost_unordered_benchmarks/tree/boost_unordered_set)
-* [Running-_n_ benchmarks, `boost::unordered_(flat|node)_map`](https://github.com/boostorg/boost_unordered_benchmarks/tree/boost_unordered_flat_map)
+Automated benchmarks of `boost::concurrent_flat_map` against [`oneapi::tbb::concurrent_hash_map`](https://spec.oneapi.io/versions/latest/elements/oneTBB/source/containers/concurrent_hash_map_cls.html) and [`gtl::parallel_flat_hash_map`](https://github.com/greg7mdp/gtl/blob/main/docs/phmap.md).
+
+## Benchmarks
+TBW
+
+## How to read the results
+### Folder
+* `gcc-x64`: GCC 12, x64
+* `clang-x64`: Clang 15, x64
+* `vs-x64`: Visual Studio 2022, x64
+* `clang-arm64`: Clang 12 ARM64
+* `gcc-x86`: GCC 12, x86
+* `clang-x86`: Clang 15, x86
+* `vs-x86`: Visual Studio 2022, x86
+
+### Excel file
+TBW
+
+## Graphs
+### GCC 12, x64
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x64/Parallel workload.xlsx.500k, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x64/Parallel workload.xlsx.500k, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x64/Parallel workload.xlsx.500k, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|500k ops, skew=0.01|500k ops, skew=0.5|500k ops, skew=0.99|
+
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x64/Parallel workload.xlsx.500M, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x64/Parallel workload.xlsx.500M, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x64/Parallel workload.xlsx.500M, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|5M ops, skew=0.01|5M ops, skew=0.5|5M ops, skew=0.99|
+
+### Clang 15, x64
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x64/Parallel workload.xlsx.500k, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x64/Parallel workload.xlsx.500k, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x64/Parallel workload.xlsx.500k, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|500k ops, skew=0.01|500k ops, skew=0.5|500k ops, skew=0.99|
+
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x64/Parallel workload.xlsx.500M, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x64/Parallel workload.xlsx.500M, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x64/Parallel workload.xlsx.500M, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|5M ops, skew=0.01|5M ops, skew=0.5|5M ops, skew=0.99|
+
+### Visual Studio 2022, x64
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x64/Parallel workload.xlsx.500k, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x64/Parallel workload.xlsx.500k, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x64/Parallel workload.xlsx.500k, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|500k ops, skew=0.01|500k ops, skew=0.5|500k ops, skew=0.99|
+
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x64/Parallel workload.xlsx.500M, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x64/Parallel workload.xlsx.500M, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x64/Parallel workload.xlsx.500M, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|5M ops, skew=0.01|5M ops, skew=0.5|5M ops, skew=0.99|
+
+
+### Clang 12, ARM64
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-arm64/Parallel workload.xlsx.500k, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-arm64/Parallel workload.xlsx.500k, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-arm64/Parallel workload.xlsx.500k, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|500k ops, skew=0.01|500k ops, skew=0.5|500k ops, skew=0.99|
+
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-arm64/Parallel workload.xlsx.500M, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-arm64/Parallel workload.xlsx.500M, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-arm64/Parallel workload.xlsx.500M, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|5M ops, skew=0.01|5M ops, skew=0.5|5M ops, skew=0.99|
+
+### GCC 12, x86
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x86/Parallel workload.xlsx.500k, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x86/Parallel workload.xlsx.500k, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x86/Parallel workload.xlsx.500k, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|500k ops, skew=0.01|500k ops, skew=0.5|500k ops, skew=0.99|
+
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x86/Parallel workload.xlsx.500M, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x86/Parallel workload.xlsx.500M, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/gcc-x86/Parallel workload.xlsx.500M, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|5M ops, skew=0.01|5M ops, skew=0.5|5M ops, skew=0.99|
+
+### Clang 15, x86
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x86/Parallel workload.xlsx.500k, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x86/Parallel workload.xlsx.500k, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x86/Parallel workload.xlsx.500k, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|500k ops, skew=0.01|500k ops, skew=0.5|500k ops, skew=0.99|
+
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x86/Parallel workload.xlsx.500M, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x86/Parallel workload.xlsx.500M, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/clang-x86/Parallel workload.xlsx.500M, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|5M ops, skew=0.01|5M ops, skew=0.5|5M ops, skew=0.99|
+
+
+### Visual Studio 2022, x86
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x86/Parallel workload.xlsx.500k, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x86/Parallel workload.xlsx.500k, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x86/Parallel workload.xlsx.500k, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|500k ops, skew=0.01|500k ops, skew=0.5|500k ops, skew=0.99|
+
+|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x86/Parallel workload.xlsx.500M, 0.01.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x86/Parallel workload.xlsx.500M, 0.5.png" width="250">|<img src="https://raw.githubusercontent.com/joaquintides/boost_unordered_benchmarks/boost_concurrent_flat_map/img/vs-x86/Parallel workload.xlsx.500M, 0.99.png" width="250">|
+|:-:|:-:|:-:|
+|5M ops, skew=0.01|5M ops, skew=0.5|5M ops, skew=0.99|