GIFT-Grab: Real-time C++ and Python multi-channel video...

Abstract

GIFT-Grab is an open-source API for acquiring, processing and encoding video streams in real time. GIFT-Grab supports video acquisition using various frame-grabber hardware as well as from standard-compliant network streams and video files. The current GIFT-Grab release allows for multi-channel video acquisition and encoding at the maximum frame rate of supported hardware – 60 frames per second (fps). GIFT-Grab builds on well-established highly configurable multimedia libraries including FFmpeg and OpenCV. GIFT-Grab exposes a simplified high-level API, aimed at facilitating integration into client applications with minimal coding effort. The core implementation of GIFT-Grab is in C++11. GIFT-Grab also features a Python API compatible with the widely used scientific computing packages NumPy and SciPy.

GIFT-Grab was developed for capturing multiple simultaneous intra-operative video streams from medical imaging devices. Yet due to the ubiquity of video processing in research, GIFT-Grab can be used in many other areas. GIFT-Grab is hosted and managed on the software repository of the Centre for Medical Image Computing (CMIC) at University College London, and is also mirrored on GitHub. In addition it is available for installation from the Python Package Index (PyPI) via the pip installation tool.

Funding statement: This work was supported through an Innovative Engineering for Health award by the Wellcome Trust [WT101957], the Engineering and Physical Sciences Research Council (EPSRC) [NS/A000027/1] and a National Institute for Health Research Biomedical Research Centre UCLH/UCL High Impact Initiative. Sébastien Ourselin receives funding from the EPSRC (EP/H046410/1, EP/J020990/1, EP/K005278) and the MRC (MR/J01107X/1). Luis C. García-Peraza-Herrera is supported by the EPSRC-funded UCL Centre for Doctoral Training in Medical Imaging (EP/L016478/1).

References

GIFT-Grab on GitHub URL: https://github.com/gift-surg/GIFT-Grab [Online; accessed 04-Aug-2017]
Search in Google Scholar Back to article
van der Walt S Colbert S C Varoquaux G The NumPy Array: A Structure for Efficient Numerical Computation Computing in Science Engineering 2011 13 2 22 30 10.1109/MCSE.2011.37 ISSN 1521-9615
Open DOI Search in Google Scholar Back to article
Jones E Oliphant T Peterson P SciPy: Open source scientific tools for Python URL: http://www.scipy.org/ [Online; accessed 01-Mar-2017]
Search in Google Scholar Back to article
GIFT-Grab on Python Package Index URL: https://pypi.org/project/GIFT-Grab [Online; accessed 04-Aug-2017]
Search in Google Scholar Back to article
pip URL: https://pip.pypa.io [Online; accessed 01-Mar-2017]
Search in Google Scholar Back to article
FFmpeg URL: https://www.ffmpeg.org/ [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
OpenCV (Open Source Computer Vision) URL: http://opencv.org/ [Online; accessed 16-Mar-2017]
Search in Google Scholar Back to article
GIFT-Surg Homepage URL: http://www.gift-surg.ac.uk [Online; accessed 22-Nov-2016]
Search in Google Scholar Back to article
Daga P Chadebecq F Shakir D I Garcia-Peraza-Herrera L C Tella M Dwyer G David A L Deprest J Stoyanov D Vercauteren T Ourselin S Real-time mosaicing of fetoscopic videos using SIFT Proc SPIE 2016 10.1117/12.2217172 9786: 97861R–97861R–7
Open DOI Search in Google Scholar Back to article
García-Peraza-Herrera L C Li W Gruijthuijsen C Devreker A Attilakos G Deprest J Vander Poorten E Stoyanov D Vercauteren T Ourselin S Real-Time Segmentation of Non-rigid Surgical Tools Based on Deep Learning and Tracking 2017 Cham Springer International Publishing 84 95 978-3-319-54057-3 10.1007/978-3-319-54057-3_8
Open DOI Search in Google Scholar Back to article
High efficiency video coding Recommendation ITU-T H.265 2015 Geneva, CH International Telecommunication Union
Search in Google Scholar Back to article
Xvid URL: https://www.xvid.com/ [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
DVI2PCIe Duo – Epiphan’s high performance PCIe capture card URL: https://www.epiphan.com/products/dvi2pcie-duo/ [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
Shvets A Pavlova M Frey G Design Patterns Explained Simply URL: https://sourcemaking.com [Online; accessed 24-Nov-2016]
Search in Google Scholar Back to article
Support – Epiphan Video URL: https://www.epiphan.com/support/ [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
Stroustrup B The C++ Programming Language Addison-Wesley Professional 2013 4th edition 0321563840 9780321563842
Search in Google Scholar Back to article
Sample HEVC Video Files URL: https://x265.com/hevc-video-files/ [Online; accessed 4-May-2017]
Search in Google Scholar Back to article
Information technology – Coding of audio-visual objects – Part 14: MP4 file format Standard ISO/IEC 14496-14:2003 2003 Geneva, CH International Organization for Standardization
Search in Google Scholar Back to article
Dawes B Boost Timer Library URL: http://www.boost.org/libs/timer/doc/ [Online; accessed 4-May-2017]
Search in Google Scholar Back to article
NVIDIA Corporation NVIDIA System Management Interface URL: https://developer.nvidia.com/nvidia-system-management-interface [Online; accessed 4-May-2017]
Search in Google Scholar Back to article
Kitware, Inc. CMake URL: http://cmake.org/ [Online; accessed 16-Mar-2017]
Search in Google Scholar Back to article
Medical device software – Software life cycle processes Standard IEC 62304:2006 2006 Geneva, CH International Organization for Standardization
Search in Google Scholar Back to article
Höss A Lampe C Panse R Ackermann B Naumann J Jäkel O First experiences with the implementation of the European standard EN 62304 on medical device software for the quality assurance of a radiotherapy unit Radiation Oncology 2014 9 1 79 10.1186/1748-717X-9-79 ISSN 1748-717X
Open DOI Search in Google Scholar Back to article
GitLab URL: https://about.gitlab.com/ [Online; accessed 10-May-2017]
Search in Google Scholar Back to article
GitLab Continuous Integration & Deployment Pipelines URL: https://about.gitlab.com/features/gitlab-ci-cd/ [Online; accessed 10-May-2017]
Search in Google Scholar Back to article
Redmine URL: http://www.redmine.org/ [Online; accessed 10-May-2017]
Search in Google Scholar Back to article
Jenkins URL: https://jenkins.io/ [Online; accessed 10-May-2017]
Search in Google Scholar Back to article
Beck Test Driven Development: By Example 2002 Boston, MA, USA Addison-Wesley Longman Publishing Co., Inc. 0321146530
Search in Google Scholar Back to article
Kitware, Inc. CMake/Testing with CTest URL: https://cmake.org/Wiki/CMake/Testing_With_CTest [Online; accessed 16-Mar-2017]
Search in Google Scholar Back to article
philsquared/Catch: A modern, C++-native, header-only, framework for unittests, TDD and BDD C++ Automated Test Cases in Headers URL: https://github.com/philsquared/Catch [Online; accessed 07-Dec-2016]
Search in Google Scholar Back to article
pytest: helps you write better programs – pytest documentation URL: http://doc.pytest.org/ [Online; accessed 07-Dec-2016]
Search in Google Scholar Back to article
Markdown – GitLab Documentation URL: https://docs.gitlab.com/ce/user/markdown.html [Online; accessed 10-May-2017]
Search in Google Scholar Back to article
Install GIFT-Grab from the Python Packaging Index URL: https://github.com/gift-surg/GIFT-Grab/blob/master/doc/pypi.md [Online; accessed 16-Jun-2017]
Search in Google Scholar Back to article
Blackmagic Design: DeckLink Models URL: https://www.blackmagicdesign.com/products/decklink/models [Online; accessed 23-Jan-2017]
Search in Google Scholar Back to article
NVIDIA VIDEO CODEC SDK|NVIDIA Developer URL: https://developer.nvidia.com/nvidia-video-codec-sdk [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
GCC, the GNU Compiler Collection URL: https://gcc.gnu.org/ [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
Van Rossum G Drake F L Python language reference manual. Network Theory 2003
Search in Google Scholar Back to article
Abrahams D Seefeld S Boost.Python URL: http://www.boost.org/libs/python/doc/ [Online; accessed 16-Mar-2017]
Search in Google Scholar Back to article
pkg-config URL: https://www.freedesktop.org/wiki/Software/pkg-config/ [Online; accessed 07-Dec-2016]
Search in Google Scholar Back to article
x265 HEVC Encoder/H.265 Video Codec URL: http://x265.org/ [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
The WebM Project|Developer Overview URL: http://www.webmproject.org/code/ [Online; accessed 07-Dec-2016]
Search in Google Scholar Back to article
Viitanen M Koivula A Lemmetti A Ylä-Outinen A Vanne J Hämäläinen T D Kvazaar: Open-Source HEVC/H.265 Encoder Proceedings of the 2016 ACM on Multimedia Conference, MM ’16, 1179–1182 2016 New York, NY, USA ACM 978-1-4503-3603-1 10.1145/2964284.2973796
Open DOI Search in Google Scholar Back to article
libVLC URL: https://wiki.videolan.org/LibVLC [Online; accessed 07-Dec-2016]
Search in Google Scholar Back to article
zlib Home Site URL: http://www.zlib.net/ [Online; accessed 07-Dec-2016]
Search in Google Scholar Back to article
Blackmagic Design: Support Center URL: https://www.blackmagicdesign.com/support [Online; accessed 23-Jan-2017]
Search in Google Scholar Back to article
POSIX.1-2008, 2016 Standard IEEE Std 1003.1™-2008, Institute of Electrical and Electronics Engineers, Inc. and The Open Group New York, NY, USA and Reading, Berkshire, UK URL: http://pubs.opengroup.org/onlinepubs/9699919799/ [Online; accessed 07-Dec-2016]
Search in Google Scholar Back to article
Doxygen: Main Page URL: http://www.doxygen.org/ [Online; accessed 25-Nov-2016]
Search in Google Scholar Back to article
Stoyanov D Scarzanella M V Pratt P Yang G Z Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery 2010 Berlin, Heidelberg Springer Berlin Heidelberg 275 282 978-3-642-15705-9 10.1007/978-3-642-15705-9_34
Open DOI Search in Google Scholar Back to article
Pratt P Jaeger A Hughes-Hallett A Mayer E Vale J Darzi A Peters T Yang G Z Robust ultrasound probe tracking: initial clinical experiences during robot-assisted partial nephrectomy International Journal of Computer Assisted Radiology and Surgery 2015 10 12 1905 1913 10.1007/s11548-015-1279-x ISSN 1861-6429
Open DOI Search in Google Scholar Back to article
Atasoy S Mateus D Meining A Yang G Z Navab N Targeted Optical Biopsies for Surveillance Endoscopies 2011 Berlin, Heidelberg Springer Berlin Heidelberg 83 90 978-3-642-23626-6 10.1007/978-3-642-23626-6_11
Open DOI Search in Google Scholar Back to article
Kim B S Lee S H Cho N I Real-time panorama image synthesis by fast camera pose estimation Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference 2012 1 4
Search in Google Scholar Back to article
Leotta M J Mundy J L Vehicle Surveillance with a Generic, Adaptive, 3D Vehicle Model IEEE Transactions on Pattern Analysis and Machine Intelligence 2011 33 7 1457 1469 10.1109/TPAMI.2010.217 ISSN 0162-8828
Open DOI Search in Google Scholar Back to article
Yang X Sun Q Tian Q Content-based video identification: a survey International Conference on Information Technology: Research and Education. Proceedings. ITRE2003 2003 50 54 10.1109/ITRE.2003.1270570
Open DOI Search in Google Scholar Back to article

GIFT-Grab: Real-time C++ and Python multi-channel video capture, processing and encoding API

Abstract

Paradigm

My account