* explicit import testing

* Enable init api for extension modules

* Better error message handling for contrib

* fix lint

* fix testcase

* fix test

This reverts commit 12d15704d7f5d30cff7540f1fd16be64c6baca68.

* [RUNTIME] Refactor extension type handling, now it is header only

* update c++ pool and softmax

* clean up reduce axis

* Add basic dense scheduler

* Revert to put back cpp dense registration

* Fix lint

* add winograd for mali

* fix lint

* add padding

* fix comment

* [Documentation Changes] Parameter description change for reduction api

The parameter description is updated for max, min, argmax and argmin

* Lint changes on patch-3 of reduction.py

* add 4 dim softmax

* update for NHWC layout

* remove layout param from softmax

* fix typo

* minor fix to pool

support axis=1 ndims=5 softmax.

add softmax axis

* few fix for softmax

* fix typo

* add more doc

* minor doc fix

* fix upsampling output shape

* fix lint

* cleanup softmax

* minor fix

* raise exception instead of assert, handles negative axis

* check axis after axis transformation

* conv2d schedules for Intel CPU (AVX2 & AVX512)

* fix lint

* remove override register

* [PASS] Enable StorageRewrite before virtual thread lowering

* update

* fix testcase

[TOPI][GL] OpenGL topi.

* Fixed namespacing issues in schedules

* Fixed compile error

* Added +x permission to task_cpp_topi.sh. Added C++ topi tests to Jenkinsfile

* Fixed test_topi_math.py

* Minor style fix

* Fix bugs with C++ TOPI flatten and relu

* Added regression tests. Fixed typo in CMakeLists.txt. Fixed topi cpp import removed.

* Fix Vulkan Build, add tanh to llvm instrinsic, fix halideIR

* fix llvm tanh

* [TOPI] Add compute for more operators

* Remove device except llvm

* Address comments

* Remove matmul compute

* Add outtype to boolean operator

* Address coments

* TOPI C++ bugfixes

* Fix lint

* [BACKEND] Vulkan Runtime and SPIRV Codegen

* fix doc

* Update HalideIR commit to include TVM_STATIC_IR_FUNCTOR_REGISTER

* Fix HalideIR to point to the right commit

* Add missing using to C++ TOPI nn.h

* Update HalideIR to include compiler error fix

* Fixed error where broadcast_to fails if shape is tuple of IntImm

* Change get_const_int to support int as input

* Ported injective schedules to C++. Added some elementwise ops.

* Fix lint errors

* Added reduction ops and schedules

* Fix lint errors

* Fix lint errors

* Fix lint errors

* Added transform ops

* Fix lint errors

* Fix lint errors

* Added softmax, log_softmax, leaky_relu and flatten ops.
Fixed issue where TVM_DECLARE_INTRIN_UNARY used the PureExtern flag
instead of PureIntrinsic.
Added softmax CUDA schedule.

* Fix lint

* Fix lint

* Added binary_dense, batch_norm_inference, dense, dilate, scale_shift_*,
global_pool and pool ops.
Extended pad to allow specifying pad_value.
Fixed issue where pad would throw if padding was zero in all dimensions.

* Fix lint

* Fix lint

* Added CUDA schedules for dense, pool and global_pool

* Added extern schedules for generic and CUDA

* Fix lint

* Added x86 binary schedules

* Fix lint

* Added rocm dense schedule. Added rocBLAS and cuBLAS support to dense ops

* Added pow ops. Added x86 default and injective schedules

* Fix lint

* Fix lint

* Fix lint

* Fix lint

* Fix lint

* Fix indent

* Removed schedules directory

* Changed left_shift, right_shift to operators. Changed pad_value in pad() to remove pointer usage

* Fixed usage of pad in nn/pooling.h. Fixed declaration of operator>>

* Fixed comments for shift operators

* Added comments to utility functions

* Added TOPI C++ library, exporting broadcast_add op

* Fix lint

* Share libinfo.py with TVM

* Fix lint

* Add other broadcast ops

* Fix lint

* Fix imports in topi

* Fix lib names

* Fixed build issue where windows builds don't apply correct definitions

* Removed TVM_EXPORTS from topi library

* Attempted CI build fix

* Add topi lib to tvm_multilib

* Fix Jenkinsfile

* Added TOPI build target to Makefile

* Fix nn op namespaces.

* Fix lint

* Renamed TOPI lib to libtvm_topi

* Removed _ffi/base.py

* Remove _ffi from topi, now shared with tvm.

* Make libtvm_topi loading optional

* Fix compiler warnings

* Fix lint

* Fix lint

* Fix lint

* Fix build error by making new libs argument to Target optional

* Added C++ Target type interop. Added registration of remaining C++ ops and schedules. Added test of broadcast ops

* Fix lint

* Fix lint

* Fix compile error

* Fix compiler warnings

* Fix compiler warnings

* Fixed int vector interop. Fixed argmin incorrectly invoking argmax. Fixed corner case in default schedules of attempting to fuse 0 length axes. Added tests for reduce ops.

* Refactored reduce builders

* Fixed typos in topi.cc. Added basic test.

* Fixed padding size error. Added dense, dilate, pooling tests

* Fixed issue where clip would output a different dtype to the input. Added split_sections op to cover the other mode of the python split op. Added tests.

* Changed extension type numbers to avoid clash with NNVM

* Fix lint

* Fix compiler warnings

* Removed use of std::vector from the public TOPI API

* Fix lint

* Add TOPI C++ tests to CI

* Fixed detail namespacing. Improved comments.

* fix upsampling output shape

* simplify expr in get_const_tuple

* add basic x86 schedules

* parallelize & vectorize batchnorm + relu

* fuse conv into bn + relu

* move rc loop to outer

* add nhwc conv

* change weight layout to hwcf

* conv + bn + relu fusion for nhwc conv

* fix conv_nhwc schedule when no fusion

* clean up default parallel schedules

* simplify elemwise parallel

* fix elemwise parallel for batch == 1

* update nhwc conv test

* fix and add comment

* fix lint

* remove redundant import

* remove default multithreading for some ops

* remove default multithreading for global pool

* add schedule for ARM Mali GPU

* fix lint

* fix lint

* support more argument type in depthwise_conv2d

* mark all pointer as 'restrict' & fix vector conversion for opencl

try to fix

fix

* [LLVM] Enable same target option in JITModule

* not set mcpu explicitly

* add upsampling cpu op

* add upsampling gpu schedule

* add doc for upsampling op

add more doc

* cleanup upsampling test

* add doc

* fix lint

* fix lint

* fix lint

* remove unused import

* remove skimage dependency

* remove skimage import

* remove schedule_upsampling

* rocblas integration

* fix include

* fix lint

* add cublas support

* integrate cublas to topi dense

* add cublas error check

* minor fix

* fix lint

* remove topi import from contrib unittest