NumCpp(C++版本Numpy)使用筆記

版權(quán)聲明：本文為博主原創(chuàng)文章，遵循 CC 4.0 BY-SA 版權(quán)協(xié)議，轉(zhuǎn)載請(qǐng)附上原文出處鏈接和本聲明。
本文鏈接：https://blog.csdn.net/Tosonw/article/details/91860627

一、簡(jiǎn)介

NumCpp：Python NumPy庫(kù)的一個(gè)Templatized Header Only C ++實(shí)現(xiàn)
NumCpp 是一個(gè)高性能的數(shù)學(xué)計(jì)算 C++ 庫(kù)，它提供了一個(gè)簡(jiǎn)單的 Numpy/Matlab 類(lèi)似的接口。
NumCpp中的主要數(shù)據(jù)結(jié)構(gòu)是NdArray。它本質(zhì)上是一個(gè) 2D 數(shù)組類(lèi)，一維數(shù)組實(shí)現(xiàn)為1xN數(shù)組。還有一個(gè)DataCube類(lèi)作為便利容器提供，用于存儲(chǔ)2D數(shù)組NdArray，但它通過(guò)簡(jiǎn)單容器的用途有限。

地址 https://github.com/dpilger26/NumCpp
文檔地址 https://dpilger26.github.io/NumCpp/doxygen/html/index.html
二、使用
1.源碼

$ git clone https://github.com/dpilger26/NumCpp


源碼中的src文件夾下的文件能夠直接被項(xiàng)目使用：

# 拷貝到項(xiàng)目中
$ cp NumCpp/src/ /home/toson/project/pro1/


// 引用頭文件即可使用
#include"src/NumCpp.hpp"


三、程序

#include"NumCpp.hpp"
#include"boost/filesystem.hpp"
#include

int main()
{
??? // Containers
??? nc::NdArray a0 = { {1, 2}, {3, 4} };
??? nc::NdArray a1 = { {1, 2}, {3, 4}, {5, 6} };
??? a1.reshape(2, 3);
??? auto a2 = a1.astype();

??? // Initializers
??? auto a3 = nc::linspace(1, 10, 5);
??? auto a4 = nc::arange(3, 7);
??? auto a5 = nc::eye(4);
??? auto a6 = nc::zeros(3, 4);
??? auto a7 = nc::NdArray(3, 4) = 0;
??? auto a8 = nc::ones(3, 4);
??? auto a9 = nc::NdArray(3, 4) = 1;
??? auto a10 = nc::nans(3, 4);
??? auto a11 = nc::NdArray(3, 4) = nc::constants::nan;
??? auto a12 = nc::empty(3, 4);
??? auto a13 = nc::NdArray(3, 4);

??? // Slicing/Broadcasting
??? auto a14 = nc::Random::randInt({ 10, 10 }, 0, 100);
??? auto value = a14(2, 3);
??? auto slice = a14({ 2, 5 }, { 2, 5 });
??? auto rowSlice = a14(a14.rSlice(), 7);
??? auto values = a14[a14 > 50];
??? a14.putMask(a14 > 50, 666);

??? // Random
??? nc::Random<>::seed(666);
??? auto a15 = nc::Random::randN({3, 4});
??? auto a16 = nc::Random::randInt({3, 4}, 0, 10);
??? auto a17 = nc::Random::rand({3, 4});
??? auto a18 = nc::Random::choice(a17, 3);

??? // Concatenation
??? auto a = nc::Random::randInt({3, 4}, 0, 10);
??? auto b = nc::Random::randInt({3, 4}, 0, 10);
??? auto c = nc::Random::randInt({3, 4}, 0, 10);

??? auto a19 = nc::stack({ a, b, c }, nc::Axis::ROW);
??? auto a20 = nc::vstack({ a, b, c });
??? auto a21 = nc::hstack({ a, b, c });
??? auto a22 = nc::append(a, b, nc::Axis::COL);

??? // Diagonal, Traingular, and Flip
??? auto d = nc::Random::randInt({5, 5}, 0, 10);
??? auto a23 = nc::diagonal(d);
??? auto a24 = nc::triu(a);
??? auto a25 = nc::tril(a);
??? auto a26 = nc::flip(d, nc::Axis::ROW);
??? auto a27 = nc::flipud(d);
??? auto a28 = nc::fliplr(d);

??? // iteration
??? for (auto it = a.begin(); it < a.end(); ++it)
??? {
??????? std::cout << *it << " ";
??? }
??? std::cout << std::endl;

??? for (auto& arrayValue : a)
??? {
??????? std::cout << arrayValue << " ";
??? }
??? std::cout << std::endl;

??? // Logical
??? auto a29 = nc::where(a > 5, a, b);
??? auto a30 = nc::any(a);
??? auto a31 = nc::all(a);
??? auto a32 = nc::logical_and(a, b);
??? auto a33 = nc::logical_or(a, b);
??? auto a34 = nc::isclose(a, b);
??? auto a35 = nc::allclose(a, b);

??? // Comparisons
??? auto a36 = nc::equal(a, b);
??? auto a37 = a == b;
??? auto a38 = nc::not_equal(a, b);
??? auto a39 = a != b;
??? auto a40 = nc::nonzero(a);

??? // Minimum, Maximum, Sorting
??? auto value1 = nc::min(a);
??? auto value2 = nc::max(a);
??? auto value3 = nc::argmin(a);
??? auto value4 = nc::argmax(a);
??? auto a41 = nc::sort(a, nc::Axis::ROW);
??? auto a42 = nc::argsort(a, nc::Axis::COL);
??? auto a43 = nc::unique(a);
??? auto a44 = nc::setdiff1d(a, b);
??? auto a45 = nc::diff(a);

??? // Reducers
??? auto value5 = nc::sum(a);
??? auto a46 = nc::sum(a, nc::Axis::ROW);
??? auto value6 = nc::prod(a);
??? auto a47 = nc::prod(a, nc::Axis::ROW);
??? auto value7 = nc::mean(a);
??? auto a48 = nc::mean(a, nc::Axis::ROW);
??? auto value8 = nc::count_nonzero(a);
??? auto a49 = nc::count_nonzero(a, nc::Axis::ROW);

??? // I/O
??? a.print();
??? std::cout << a << std::endl;

??? auto tempDir = boost::filesystem::temp_directory_path();
??? auto tempTxt = (tempDir / "temp.txt").string();
??? a.tofile(tempTxt, "\n");
??? auto a50 = nc::fromfile(tempTxt, "\n");

??? auto tempBin = (tempDir / "temp.bin").string();
??? nc::dump(a, tempBin);
??? auto a51 = nc::load(tempBin);

??? // Mathematical Functions

??? // Basic Functions
??? auto a52 = nc::abs(a);
??? auto a53 = nc::sign(a);
??? auto a54 = nc::remainder(a, b);
??? auto a55 = nc::clip(a, 3, 8);
??? auto xp = nc::linspace(0.0, 2.0 * nc::constants::pi, 100);
??? auto fp = nc::sin(xp);
??? auto x = nc::linspace(0.0, 2.0 * nc::constants::pi, 1000);
??? auto f = nc::interp(x, xp, fp);

??? // Exponential Functions
??? auto a56 = nc::exp(a);
??? auto a57 = nc::expm1(a);
??? auto a58 = nc::log(a);
??? auto a59 = nc::log1p(a);

??? // Power Functions
??? auto a60 = nc::power(a, 4);
??? auto a61 = nc::sqrt(a);
??? auto a62 = nc::square(a);
??? auto a63 = nc::cbrt(a);

??? // Trigonometric Functions
??? auto a64 = nc::sin(a);
??? auto a65 = nc::cos(a);
??? auto a66 = nc::tan(a);

??? // Hyperbolic Functions
??? auto a67 = nc::sinh(a);
??? auto a68 = nc::cosh(a);
??? auto a69 = nc::tanh(a);

??? // Classification Functions
??? auto a70 = nc::isnan(a.astype());
??? //nc::isinf(a);

??? // Linear Algebra
??? auto a71 = nc::norm(a);
??? auto a72 = nc::dot(a, b.transpose());

??? auto a73 = nc::Random::randInt({3, 3}, 0, 10);
??? auto a74 = nc::Random::randInt({4, 3}, 0, 10);
??? auto a75 = nc::Random::randInt({1, 4}, 0, 10);
??? auto value9 = nc::linalg::det(a73);
??? auto a76 = nc::linalg::inv(a73);
??? auto a77 = nc::linalg::lstsq(a74, a75);
??? auto a78 = nc::linalg::matrix_power(a73, 3);
??? auto a79 = nc::linalg::multi_dot({ a, b.transpose(), c });

??? nc::NdArray u;
??? nc::NdArray s;
??? nc::NdArray vt;
??? nc::linalg::svd(a.astype(), u, s, vt);

??? return 0;
}


四、如果有問(wèn)題
1.遇到頭文件問(wèn)題

fatal error: NumCpp/Types.hpp: No such file or directory
?#include"NumCpp/Types.hpp"


請(qǐng)檢查CMakeLists.txt中：include_directories()中包含路徑。
2.依賴問(wèn)題

/usr/local/include/boost/math/special_functions/lanczos.hpp:104:25: note: use -std=gnu++11 or -fext-numeric-literals to enable more built-in suffixes
/usr/local/include/boost/math/special_functions/lanczos.hpp:105:25: error: unable to find numeric literal operator ‘operator""Q’
????????? static_cast(BOOST_MATH_BIG_CONSTANT(T, 35, 32.12388941444332003446077108933558534361)),


參照依賴項(xiàng)：

??? C ++標(biāo)準(zhǔn)： C ++ 11，C ++ 14 或 C ++ 17
??? 編譯器： VS 2017/2019，GCC 7.4.0 或 Clang 6.0
??? Boost版本： 1.68 或 1.70

檢查GCC版本

$ gcc -v
gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.11)


檢查boost版本

$ dpkg -S /usr/include/boost/version.hpp
libboost1.68-dev:amd64: /usr/include/boost/version.hpp


附：boost編譯
下載boost1.68：https://dl.bintray.com/boostorg/release/1.68.0/source/

$ tar -zxvf boost_1_68_0.tar.gz
$ cd boost_1_68_0/
# 編譯
$ ./bootstrap.sh --with-libraries=all --with-toolset=gcc
# 安裝
$ ./b2 install --prefix=/usr


3. Linux編譯問(wèn)題

note: use -std=gnu++11 or -fext-numeric-literals to enable more built-in suffixes
error: unable to find numeric literal operator ‘operator""Q’
static_cast(BOOST_MATH_BIG_CONSTANT(T, 35, 32.12388941444332003446077108933558534361)),


需要在項(xiàng)目中的CMake編譯選項(xiàng)中增加：

SET(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -fext-numeric-literals")


In function `boost::system::generic_category()':
undefined reference to `boost::system::detail::generic_category_ncx()'


在CMake編譯時(shí)需要依賴庫(kù)：boost_system
五、運(yùn)算效率

基于：Ubuntu 16.04LTS，Core-i7 8700，Clion

1.nc::dot運(yùn)算太耗時(shí)

auto mel = nc::dot(mel_basis, mag);???? //20ms
//注：mel_basis為shape(80,1025)，mag為shape(1025,109)

//我后來(lái)優(yōu)化為使用opencv來(lái)實(shí)現(xiàn)的
cv::Mat cv_mel = cv_mel_basis * cv_mag;???? //2ms


2.nc::log10(nc::maximum(...))運(yùn)算還將就，不過(guò)opencv更快

// to decibel?????????? //2ms
mel = nc::log10(nc::maximum(mel, nc::NdArray(mel.shape().rows, mel.shape().cols) = 1e-5)) * 20;
mag = nc::log10(nc::maximum(mag, nc::NdArray(mag.shape().rows, mag.shape().cols) = 1e-5)) * 20;
?? ?
//嘗試使用opencv來(lái)實(shí)現(xiàn)????? //0ms(<0.5ms)
cv::log(cv::max(cv_mel, 1e-5), cv_mel);


3.nc::pad()的實(shí)現(xiàn)與numpy不一樣：
numpy可以實(shí)現(xiàn)一維填充（一維數(shù)列），而numcpp會(huì)將每個(gè)維度都進(jìn)行填充。
比如我想實(shí)現(xiàn)一維數(shù)列的填充，結(jié)果出來(lái)后成為了二維數(shù)列了。
并且無(wú)法完成reflect填充。

//注：ncbuffer的shape(1,43350)
auto ncbuffer_pad = nc::pad(ncbuffer, nc::uint16(pad_lenght), 0.0);
//nc::pad()會(huì)將二維也進(jìn)行填充，成為2049*45398


我當(dāng)初是自己寫(xiě)循環(huán)實(shí)現(xiàn)的，后來(lái)使用opencv里的copyMakeBorder來(lái)完成reflect填充：

cv::copyMakeBorder(cv_padbuffer, cv_padbuffer, 0, 0, pad_lenght, pad_lenght, cv::BORDER_REFLECT_101);//cv::BORDER_REFLECT


這里發(fā)現(xiàn)opencv里copyMakeBorder的BORDER_REFLECT填充是這樣的：
例：fedcba|abcdefgh|hgfedcb
我要實(shí)現(xiàn)numpy里的reflect填充，它的效果是這樣的：
例：gfedcb|abcdefgh|gfedcba
所以應(yīng)該使用BORDER_REFLECT_101。

4.其他。。。
————————————————
版權(quán)聲明：本文為CSDN博主「Tosonw」的原創(chuàng)文章，遵循 CC 4.0 BY-SA 版權(quán)協(xié)議，轉(zhuǎn)載請(qǐng)附上原文出處鏈接及本聲明。
原文鏈接：https://blog.csdn.net/Tosonw/article/details/91860627