iOS上圖像處理編程的工具庫

說明

1. 摘自綜述 《Image Processing and Computer Vision in iOS》, Oge Marques, Springer, 2020

2. 注意出版時間是2020年蜓斧,后面的進展請補充

3. 對初學,想了解拿穴,學習路徑男图,現(xiàn)有的工具庫

4. CSDN上2018年的文章?iOS圖形處理概論:OpenGL ES,Metal汉柒,Core Graphics仔掸,Core Image憔儿,GPUImage赠堵,OpenCV等?可做參照


名詞?Image Processing, Image Analysis, Computer Vision, and IPCV

1. Image processing 圖像處理

2. Image analysis 圖像分析

3. Computer vision 計算機視覺

上面3者邊界模糊小渊,統(tǒng)一叫做:IPCV ?image processing and computer vision,更大的叫法是:intelligent processing of visual information茫叭。一個 IPCV 的 pipeline (or workflow) 往往包含了許多步驟酬屉,每步可以是上面3者之一。


學習路徑

These are the suggested steps to learn the basic steps that should lead you to become a successful developer of IPCV iOS apps.

1. Get a Mac computer. You will need a Mac to run Xcode.

2. Download and install Xcode.

3. Sign up with Apple to become a registered iOS developer.

4. Learn the basics of iOS programming using Swift.

5. Get an iPhone and/or iPad to test your apps.

6. Learn about useful Apple frameworks, libraries, and APIs for IPCV tasks, particularly Core Image, Core ML, and the Vision Framework.

7. Read as much as you can (books, blogs, Apple documentation, tutorials, etc.).

8. Practice, practice, practice.


語言的選擇 Swift and Objective-C

Most of the code for iOS today is written in Swift. However, for legacy apps or IPCV apps that need to interface with OpenCV (see Chap.?6), knowledge of Objective-C and/or C++ is crucial.


用戶界面庫的選擇 UIKit and SwiftUI

If you’re new to iOS development, experts recommend that you learn?UIKit first and then transition to?SwiftUI.


Useful Frameworks, APIs, and Libraries

* 說明之后再補

1. ARKit — Apple Developer Documentation.?

2. AVFoundation — Apple Developer Documentation.?

3. AVKit — Apple Developer Documentation.?

4. Core Graphics — Apple Developer Documentation.?

? based on 5. Quartz 2D: Introduction?—?Apple Developer Documentation.

6. Core Image — Apple Developer Documentation.?

7. Core Media — Apple Developer Documentation.?

8. Core ML?— Apple Developer Documentation.?

9. Core Video — Apple Developer Documentation.?

10. Create ML?— Apple Developer Documentation.?

11. Image I/O — Apple Developer Documentation.?

12. ImageCaptureCore — Apple Developer Documentation.?

13. Metal — Apple Developer Documentation.?

14. Metal Performance Shaders?

? ? ?. Image Filters —Apple Developer Documentation.

? ? ?. Training a Neural Network with Metal Performance Shaders —?Apple Developer Documentation.?

15. ML Compute — Apple Developer Documentation.?

16. OpenGL ES — Apple Developer Documentation.?

17. PhotoKit — Apple Developer Documentation.?

18. VideoToolbox — Apple Developer Documentation.?

19. Apple Vision Framework?—Apple Developer Documentation.

20. VisionKit — Apple Developer Documentation.?


iOS 編程學習資源

1. Apple Developer Program —?Apple Developer.?

2. Stanford University's CS193p -?Developing Apps for iOS.

3. Xcode — Apple Developer Documentation.?

4. Swift — Resources —?Apple Developer Documentation.

5. The Swift Programming Language (Swift 5.3 beta) on?Apple Books.

6.?Ray Wanderlich’s site is a rich source for high-quality books, tutorials, courses, and videos on iOS and mobile app development.


參考書

1. Fahim Farook.?UIKit Apprentice. Ray Wanderlich's site.

2. C. Eidhof.?App architecture. objc, Berlin, Germany, 2018.

3. A. Kaehler and G. Bradski.?Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library. O’Reilly Media, Inc., 2017.

4. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classifification with deep convolutional neural networks. In?Advances in neural information processing systems, pages 1097–1105, 2012.

5. O. Marques.?Practical Image and Video Processing Using MATLAB. Wiley - IEEE. Wiley, 2011.


云計算服務

1. Amazon Web Services (AWS) —?Cloud Computing Services. .

2. Cloud AutoML—?Google Cloud.

3. Cognitive Services: APIs for AI Developers —?Microsoft Azure.


其他平臺上的工具庫

MATLAB —?MathWorks.

for C++ and Python:

? ? OpenCV?

for Java:

? ? 1. ImageJ.?

? ? 2. Fiji: ImageJ, with “Batteries Included”.?


objc.io的兩期雜志

Two special issues of the?objc.io?electronic magazine remain relevant for getting a deeper understanding of the development process behind mobile visual computing apps in iOS:

? Issue 21: Camera and Photos [objc.io], which covers a wide range of topics, from image acquisition using the iPhone camera to selected frameworks, extensions, and GPU-accelerated apps.

? Issue 23: Video [objc.io], which extends the discussion to video capturing, fifiltering, and hardware acceleration.


其他

Augmented Reality —?Apple.?


最后編輯于
?著作權歸作者所有,轉載或內容合作請聯(lián)系作者
  • 序言:七十年代末,一起剝皮案震驚了整個濱河市呐萨,隨后出現(xiàn)的幾起案子杀饵,更是在濱河造成了極大的恐慌,老刑警劉巖垛吗,帶你破解...
    沈念sama閱讀 218,858評論 6 508
  • 序言:濱河連續(xù)發(fā)生了三起死亡事件凹髓,死亡現(xiàn)場離奇詭異烁登,居然都是意外死亡怯屉,警方通過查閱死者的電腦和手機,發(fā)現(xiàn)死者居然都...
    沈念sama閱讀 93,372評論 3 395
  • 文/潘曉璐 我一進店門饵沧,熙熙樓的掌柜王于貴愁眉苦臉地迎上來锨络,“玉大人,你說我怎么就攤上這事狼牺∠鄱” “怎么了?”我有些...
    開封第一講書人閱讀 165,282評論 0 356
  • 文/不壞的土叔 我叫張陵是钥,是天一觀的道長掠归。 經常有香客問我,道長悄泥,這世上最難降的妖魔是什么虏冻? 我笑而不...
    開封第一講書人閱讀 58,842評論 1 295
  • 正文 為了忘掉前任,我火速辦了婚禮弹囚,結果婚禮上,老公的妹妹穿的比我還像新娘。我一直安慰自己虱朵,他們只是感情好余境,可當我...
    茶點故事閱讀 67,857評論 6 392
  • 文/花漫 我一把揭開白布。 她就那樣靜靜地躺著毁渗,像睡著了一般践磅。 火紅的嫁衣襯著肌膚如雪。 梳的紋絲不亂的頭發(fā)上灸异,一...
    開封第一講書人閱讀 51,679評論 1 305
  • 那天府适,我揣著相機與錄音,去河邊找鬼绎狭。 笑死细溅,一個胖子當著我的面吹牛,可吹牛的內容都是我干的儡嘶。 我是一名探鬼主播喇聊,決...
    沈念sama閱讀 40,406評論 3 418
  • 文/蒼蘭香墨 我猛地睜開眼,長吁一口氣:“原來是場噩夢啊……” “哼蹦狂!你這毒婦竟也來了誓篱?” 一聲冷哼從身側響起朋贬,我...
    開封第一講書人閱讀 39,311評論 0 276
  • 序言:老撾萬榮一對情侶失蹤,失蹤者是張志新(化名)和其女友劉穎窜骄,沒想到半個月后锦募,有當?shù)厝嗽跇淞掷锇l(fā)現(xiàn)了一具尸體,經...
    沈念sama閱讀 45,767評論 1 315
  • 正文 獨居荒郊野嶺守林人離奇死亡邻遏,尸身上長有42處帶血的膿包…… 初始之章·張勛 以下內容為張勛視角 年9月15日...
    茶點故事閱讀 37,945評論 3 336
  • 正文 我和宋清朗相戀三年糠亩,在試婚紗的時候發(fā)現(xiàn)自己被綠了。 大學時的朋友給我發(fā)了我未婚夫和他白月光在一起吃飯的照片准验。...
    茶點故事閱讀 40,090評論 1 350
  • 序言:一個原本活蹦亂跳的男人離奇死亡赎线,死狀恐怖,靈堂內的尸體忽然破棺而出糊饱,到底是詐尸還是另有隱情垂寥,我是刑警寧澤,帶...
    沈念sama閱讀 35,785評論 5 346
  • 正文 年R本政府宣布另锋,位于F島的核電站滞项,受9級特大地震影響,放射性物質發(fā)生泄漏夭坪。R本人自食惡果不足惜文判,卻給世界環(huán)境...
    茶點故事閱讀 41,420評論 3 331
  • 文/蒙蒙 一、第九天 我趴在偏房一處隱蔽的房頂上張望台舱。 院中可真熱鬧律杠,春花似錦、人聲如沸竞惋。這莊子的主人今日做“春日...
    開封第一講書人閱讀 31,988評論 0 22
  • 文/蒼蘭香墨 我抬頭看了看天上的太陽拆宛。三九已至嗓奢,卻和暖如春,著一層夾襖步出監(jiān)牢的瞬間浑厚,已是汗流浹背股耽。 一陣腳步聲響...
    開封第一講書人閱讀 33,101評論 1 271
  • 我被黑心中介騙來泰國打工, 沒想到剛下飛機就差點兒被人妖公主榨干…… 1. 我叫王不留钳幅,地道東北人物蝙。 一個月前我還...
    沈念sama閱讀 48,298評論 3 372
  • 正文 我出身青樓,卻偏偏與公主長得像敢艰,于是被迫代替她去往敵國和親诬乞。 傳聞我的和親對象是個殘疾皇子,可洞房花燭夜當晚...
    茶點故事閱讀 45,033評論 2 355

推薦閱讀更多精彩內容