Show HN: Fast,Compiled deep-learning based modules for inferencing on CPUs https://ift.tt/rsK1XGS

Show HN: Fast,Compiled deep-learning based modules for inferencing on CPUs Hi HN,I am Anubhav from RamanLabs.We have been developing dedicated modules based on deep-learning for purposes like face-detection,object-detection,pose-estimation etc. We hope to make it easy for developers,hobbyists to integrate such functionalities into their existing app/pipeline at the cost of a few milliseconds.All our modules run end to end in super-realtime even on consumer-grade CPUs[0]. For now we provide only Python based API. We provide Demo for each of the modules to allow testing for your desired data distribution.We also have a blog[1] where we hope to add more technical details about the framework used to develop these modules. The framework used to develop these modules is completely written in Nim language.We wrap existing ops implementations from libraries like ONEDNN and write our own code where we cannot find one or existing implementation is not good enough,mainly for preprocessing and postprocessing code.Having full access to framework code and being written in a high level language allows us to port newer architectures and optimize them quickly. We would love to hear your feedback on our attempt. [0] Quad-core Cpu with AVX2 instructions. [1] < https://ramanlabs.in/static/blog/index.html > https://ift.tt/NutIY4B April 14, 2022 at 07:08PM