2090-CPBM7DF-10AA15 最初打算幫助殘疾人,是因為我在卡耐基梅隆讀博時,結(jié)識了一位從 IBM 到我們學校訪問的盲人教授。和她一起去朋友家時,發(fā)現(xiàn)她的生活非常不方便,這也是我設計盲人屏幕閱讀器的起因?!睂γ苄髮W計算機科學與工程系 90 后華人教授郭安鴻來說,“科技向善”是他身上抹不去的標簽。
很多人都曾在課本上學習過海倫·凱勒的《假如給我三天光明》,由于失聰和失明,她只能通過觸覺來學習說話,比如把手指放在老師的鼻子、嘴唇和咽喉上,去感受某個單詞的發(fā)音方式。
一個四肢健全的盲人固然有觸覺,但卻因為眼盲、而無法操作那些常人可以輕松操作的鍵盤,比如微波爐和電飯煲的物理操作界面。對他們來說,這些操作界面的按鈕,不僅在觸覺上難以區(qū)分,并且屏幕上還有他們無法閱讀的視覺信息。
基于此,郭安鴻研發(fā)出一款人機交互系統(tǒng),來幫助盲人讀取、以及使用物理操作界面上的內(nèi)容。
該系統(tǒng)包含三大塊:VizLens、Facade 和 Stabbbens。其中VizLens 幫助盲人通過音頻指示去使用物理操作界面,F(xiàn)acade 使用 3D 打印技術(shù)給其提供盲文標簽,而 Stabbbens 則可以幫助他們識別動態(tài)操作界面。
VizLens:可給盲人提供實時幫助
VizLens 是用于靜態(tài)物理操作界面的交互式屏幕閱讀器,它結(jié)合了按需眾包和實時計算機視覺技術(shù)。
當盲人遇到某個無法閱讀的靜態(tài)界面如微波爐界面時,使用手機對操作界面進行拍照,之后 VizLens 會把照片發(fā)送給網(wǎng)絡眾包人員。
視頻 |VizLens使用說明
眾包是一種通過互聯(lián)網(wǎng)多人協(xié)作獲得數(shù)據(jù)資源的方式,比如 Amazon Mechanical Turk 眾包網(wǎng)站就是借助遍布在互聯(lián)網(wǎng)上的自由職業(yè)者,通過他們完成一些細小工作,最終匯集在一起解決大型問題。
圖 | 用戶使用界面的操作過程(來源:受訪者)
眾包人員收到盲人的信號后,就會標記界面布局、并注釋相關元素如按鈕或其他控件,隨后會描述每個元素,描繪出的圖片也會成為參考圖像,進而幫助計算機視覺更好地工作。
之后,當盲人要操作微波爐界面時,只需打開 VizLens 應用程序,把手機攝像頭對準界面,接著把手指懸停在界面上,這時VizLens 會使用基于 SURF(Speeded Up Robust Features,加速穩(wěn)健特征)的對象匹配技術(shù),將眾包標記的參考圖像、與實時捕獲的圖像進行匹配,并跟蹤用戶的手指,進而去做檢索、提供音頻反饋和指導用戶。
2090-CPBM7DF-10AA15
ABB YB560103-CB DSQC236B DriveUnit
ABB YB560103-CC DSQC236C DriveUnit
ABB 3HAB2207-1 DSQC236D DriveUnit
ABB YB560103-CD DSQC236G DriveUnit
ABB 3HAB2207-1 DSQC236P DriveUnit
ABB YB560103-CE DSQC236T DriveUnit
ABB YB560 103-CL/5 DSQC241 PowerUnit
ABB 3HAB 2210-1 DSQC300 Robot Computer
ABB 3HAB 2216-1 DSQC314B PowerUnit
ABB 3HAB 2219-1 DSQC316 Main Computer
ABB 3HAB 2220-1 DSQC317 6MB Card
ABB 3HAB 2236-1 DSQC321 4MB Card
ABB 3HAB 5956-1 DSQC323 8MB Card
ABB 3HAB 5957-1 DSQC324 16MB Card
ABB 3HAB 2241-1 DSQC325 Main Computer
ABB 3HAB 2242-1 DSQC326 Robot Computer
ABB 3HAB7229-1 DSQC328 I/O Card
ABB 3HAB 6182-1 DSQC335 Robot Computer
ABB 3HAB8101-3/05D DSQC345B DriveUnit
ABB 3HAB8101-3/08C DSQC345C DriveUnit
ABB 3HAB8101-7/01C DSQC346C DriveUnit
ABB 3HAB8101-8 DSQC346G DriveUnit
ABB cable DSQC351 Interbus-S
ABB 3HAC 0373-1 DSQC361 Main Computer
ABB 3HAC3180-1 DSQC373 Robot Computer
ABB 900054 1Gb SD-card S3/S4 DDR
ABB 900056 1Gb SD-card S2 DDR
3HNE 00026 Teach Pendant
3HNE 00312-1 Teach Pendant
3HNE 00313 Teach Pendant
CHAA 3560-AXA Teach Pendant
ABB 3HAB9271-1/01B DriveUnit Dummy DriveUnit Dummy
ABB 57510001-AA DSCA 114 Print out board
ABB 57520001-U DSCA 121 Communication board
ABB 57160001-A DSDI 110 Digital bbbbb board
ABB 57160001-K DSDO 110 Digital output board
ABB YB161102-AH DSDX 110 Digital in/output board
ABB 57160001-TP DSDX B001 digital in-output board
ABB 57360001-U DSMB 124 Semiconductor memory board
ABB 57360001-AN DSMB 125 Semiconductor memory board
ABB 57360001-HG DSMB 127 Memory board
ABB 57330001-N DSMC 110 Floppy disk controller
ABB YB161102-AK DSPA 110 Axis computer
ABB 57310256-AF DSPC 150 Central processor
ABB 57310256-BA DSPC 153 Expand. single board computer
ABB 57310001-GP DSPC 157 Expand. single board computer
ABB YB161102-AD DSQC 103 Resolver power board
ABB YB161102-AF DSQC 105 Display board
ABB YB161102-BA DSQC 110 Programming board
ABB YB161102-BS DSQC 115 Resolver power board + 2 analogue
ABB YB161102-BE DSQC 116 Power supply
ABB YB161102-BG DSQC 117 Resolver power board
ABB YB161102-BU DSQC 124 Terminal unit
ABB YB161102-BV DSQC 129 R/D board
ABB YB161102-CH DSQC 136 Safety board
ABB YB161102-CM DSQC 138 Terminal unit
ABB YB560103-AC DSQC 202 Robot computer
ABB YB560103-AS DSQC 208A External axis board
ABB YB560103-AL DSQC 209 Analogue I/O board
ABB YB560103-AM DSQC 210 Safety board
ABB YB560103-AN DSQC 211 Power supply
ABB YB560103-BF DSQC 215 Robot computer
2090-CPBM7DF-10AA15
Fr?smaschine MAHO 600 CUniversal Werkzeugfr?smaschine Deckel FP2 Viel Zubeh?r
Schnellradiale Bohrmaschine Donau DR 23 Bj 1964
Elco Kl?ckner Kombi Heizung Brenner Gas&?lbrenner Ek-4
Radialbohrmaschine AB ARBOGA SWEDEN
L+Z Drehmaschine von Meuser Typ,M-21-4
INDRAMAT 2AD160C-B35OA1-BS03-B2N1
Zapfenschneid- und -Schlitzmaschine für Fensterbau
Siemens Sinumerik840D 6FC5203-OAB11+6FC5203-OAB11-OAA2
Heidenhain EXE 808 B unbenutzt
FANUC A16B 1010 0040/04C PC BOARD
Ballengreifer/Klammer-Anbaugr?t für Stapler
Siemens 6ES5581-OEA11+6ES5581-ORA12
Bosch QUVF 132M/4B-11 .528/3753922-1 Servomotor
AMK Servomotor mit Pulsumrichter 450/7000 /min 11KW
Elco Kl?ckner Kompaktheizzentrale Systron ?ko Plus
BBC Veritron ADD 6101 V9
Siemens 1FK6083-6AF71-1AGO Bruschless Servomotor
Contraves Vridyn Compact ADB/V190.30VD 8.5 KVA
Schnelll?ufer für Deckel Fr?smaschine
Bosch Buerstenloser Servomotor Permanenterregt SF-A5.
Bosch Buerstenloser Servomotor Permanenterregt SF-A5.
Indramat Servo MKD090B-035-GG-KN
Allen-Bradley 6189-RDT12C /6189-RPLColor Touch Display
Indramat Servo MKD090B-035-GG-KN
Siemens Simatic VS 710 6GF1 710-1AA
HEIDENHAIN DREHGEBER RON 425. 2500.ID.Nr.230 825 07
Schwenktisch für Deckel FP2 Fr?smaschine
Rexroth3-Phase,Permanent Magnet Motor Planetary Gearbox
MKD 090B-047-GG1-KN Gearbox:GTP 140-M01-010B06
Heidenhain LS 107 ML 1840 Ma?stab neu
Indramat Operator Interface Panel System 200 Mod. BTV20
Siemens Simatic 6ES5955-3LC14/6ES5155-3UA11
Bosch Buerstenloser Servomotor Permanenterregt SF-A5
Bosch Rexroth CPU ZS 401 1070077298.109
INDRAMAT Permanent magnet motor MHD093B-058-PGO-AA
Allen Bradley Versa View 1700P 6181-17TP2KH
Rexroth Brushless Permanent Magnet Motor SF-A4.0230.030
Indramat Sercos Interface CSBO1.IC-SE-ENS-L1-S-NN-FW
Fanuc Panel Control Komplett M10
Rexroth Brushless Permanent Magnet Motor SF-A4.0230.030
Emerson FX-455 bbbbbbbbing Servo Drive
Bosch Buerstenloser Servomotor Permanenterregt
Linearguide/Linearführung Schneeberger 2470mm OVP
HEIDENHAIN Ma?stab LS 106 ML 940 mm
Counter Modul Siemens 6ES5000-1AA31
R?hm Wezeughalter Nr 13192 neu VDF/Boeringer
Siemens S5 Phoenix Contact Interbus IBS S5 DCB/I-T
Rexroth3-Phase permanent Magnet MSK061C--NN-M1-UG0-NNNN
Siemens Simatic S5 6ES5241-1AA11
Siemens koppler Dezentrale 6ES7158-OADOO-OXAO
Bosch servo modul D8 K15 3301-D
Heidenhain LS 106 540 5,0 270
Doppelschleifbock,Schleifbock. bbbbBO
Siemens Sinumerik Sirotec 6FX1125-OCAO1 KUKA
Siemens Simoreg D200/40 Mreg-GcG-6V30-2A.6RA2621-6MV30
Parvex brushless Servomotor HX440CKR6000 OVP
Siemens Simatic Digital bbbbb module 6ES5434-7LA11 OVP
Siemens Simatic 6ES5350-3KA21
Siemens Push Button Panel 6FC5203-OAD21-1AA1
Fanuc bbbbb Modul ID64A AO3B-0801-C133
Siemens 6EV 1364-5AK G24V/40A Unbenutzt
Siemens 6EV 1364-5AK G24V/40A Unbenutzt
UNIPO Bildschirm 2MM112XCTN04
HSK-A100 AUFNAHME DIN 69893
Indramat Drossel Typ KD20,90A OVP
Bosch Netzanschaltmodul NAA 35/1-D
Siemens Sinumerik Sirotec 6FX1123-8CA03 KUKA
Stromag Servomotor Typ.FIP 40/0025-60 BA 1 4P
Stromag Servomotor Typ.FIP 11/0045-30AA1
BALLUFF DREHGEBER BDG BDG 6360-2-05-Wo31.1000-65//
Siemens Simatic 6ES5925-5AA12
EMERSON MOTION Control PCM 15
Indramat HGV Geberverzweigung
Siemens 6ES5432-4UA12
Lutze drossel NG 24/10 OVP
Heidenhain Drehgeber ROQ 425.5DSK-13B12
Siemens Simatic 6ES5512-5AA12
Siemens Simatic 6ES5512-5AA12
Siemens Sitop Power10 6EP1334-2AAOO
Siemens Simatic S7 DP KOppler 6ES7 158-OADOO-OXXAO
Heidenhain Verbindungskabel 3BS062 3BB062 48 12,00 05
Heidenhain Verbindungskabel 81B+70141 5.00 05.stum
Siemens Simatic 6ES5310-3AB11
Ghielmetti Tape Reader FER204 10032.02/06
Heidenhain Adapterkabel 45BOO8 31SOO9 03 3,00 09
Siemens Simatic S7 CP 342-5 6GK7342-5DAOO-OXEO
Pepperl+Fuchs N?hrungsschalter NCB40-FP-NO
Fanuc A03B-0807-C102
Scherenhebebühne TYp.101 15 TKD GmbH Kronau
特別聲明:以上內(nèi)容(如有圖片或視頻亦包括在內(nèi))為自媒體平臺“機電號”用戶上傳并發(fā)布,本平臺僅提供信息存儲服務
Notice: The content above (including the pictures and videos if any) is uploaded and posted by a user of JDZJ Hao, which is a social media platform and only provides information storage services.