6XSHUYLVRU'DQLHOD/DQJDUR 'LVVHUWDWLRQVXEPLWWHGLQSDUWLDOIXOILOOPHQWRIUHTXLUHPHQWVIRUWKHGHJUHHRI06FLQ%XVLQHVV $GPLQLVWUDWLRQDW&DWyOLFD/LVERQ6FKRRORI%XVLQHVVDQG(FRQRPLFV 0D\WK
Mobile Campus adoption in Higher Education:
Factors that influence the adoption of Católica
Lisbon School of Business and Economics’
mobile campus among students.
Francesco Paolino
152113368
i
Abstract
Dissertation Title: “Mobile Campus adoption in Higher Education: Factors that influence the
adoption of Católica Lisbon School of Business and Economics’ mobile campus among students”
Author: Francesco Paolino
A transaction from the traditional website platforms to mobile platforms is an opportunity for Católica Lisbon School of Business and Economics to create new values for students on their relationship with professors, staff and the various universities´ facilities, through the offering of improved educational services and organizational tools. Through MyCatolica, the mobile learning mobile system (LMS) of the University, new approaches on the learning processes can be
implemented, tightening the distance between universities and students. Despite the advantages, students’ adoption still needs to be further developed.
The current thesis builds its relevance on this gap, through investigating the factors that may influence the adoption of mobile campus by students.
To develop the dissertation, the qualitative research method was undertaken. Ten students were interviewed and results revealed that the website platforms are still perceived essential, and more reliable. Meantime, MyCatolica is not supportive enough and is seen as an informational tool not decisive to the student’s life. Participants have positioned MyCatolica as an application which is not useful and does not allow students to actively interact with the Academic world. Even though, the non-users perceived the benefits of using the LMS, they do not adopt MyCatolica because of its poor relative advantages and low-leveled usefulness.
Additionally, students were submitted to an exploration phase where new features were proposed in order to overcome the adoption barriers and to develop a superior MyCatolica. It was found that features as “Chat”, “Cloud” and “Note” could be helpful on overcoming the adoption barriers.
iii
Resumo
Título da Dissertação: “Mobile Campus adoption in Higher Education: Factors that influence the
adoption of Católica Lisbon School of Business and Economics’ mobile campus, among students”
Autor: Francesco Paolino
A transição das plataformas web tradicionais para as aplicações móveis é uma importante
oportunidade para a Católica Lisbon School of Business and Economics desenvolver novos valores para estudantes, e melhorar o seu relacionamento com professores, staff e entidade académicas, através da oferta melhorada de ferramentas organizacionais. Através da MyCatolica, o Sistema de gestão educativo móvel (LMS), poderão ser implementadas novas abordagens ao processo
educativo, estreitando a relação entre os estudantes e a universidade. No entanto é necessário desenvolver a aceitação por partes do alunos para esta ferramenta.
Esta tese torna se relevante pois pretende preencher esta lacuna, através da investigação de factores que possam influenciar a adopção do sistema móvel pelos estudantes.
Através de uma pesquisa qualitativa dez estudantes foram entrevistados. Os resultados revelaram que as ferramentas web tradicionais ainda são encaradas como eficientes e mais fiáveis. Por seu lado, a plataforma móvel ainda é considerada pouco complacente. Mycatolica é visto como uma ferramenta informativa não fundamental para a vida do estudante. Os participantes do estudo descrevem o Mycatolica como uma aplicação pouco útil. Apesar de os não utilizadores terem uma percepção dos eventuais benefícios da utilização do LMS, não adoptaram o MyCatolica devido à sua diminuta utilidade.
Adicionalmente, aos estudantes foram sugeridas novas características de modo a poder contornar os obstáculos à aceitação da aplicação. Novas funcionalidades tais como “Chat”, “Cloud” e “Notas” poderiam ser úteis para ultrapassar as barreiras de utilização uma vez que mostravam maiores benefícios no apoio à vida académica dos estudantes.
v
List of Acronyms:
ACRL - Association of College and Research Libraries DOI - Diffusion of Innovation model
EBSCO - Elton Bryson Stephens Company ESCA - E-Serviços ao Cidadão Académico
IDMP - Integrated Digital Mobile Learning Platform IT - Information Technology
LMS - Learning Mobile System PC - Personal Computer
QR - Quick Response SI - Social Influence
TAM - Technology acceptance model VAM - Value-Based Model
vii
Table of content
1 Introduction ... 1
1.1 Internet and Mobile Devices Growth ... 1
1.2 The era of Social Media... 2
1.3 Mobile applications in the Era of Social Media ... 3
1.4 Problem Statement: ... 3
1.5 Research Objectives ... 4
1.6 Research questions: ... 4
2 Literature review ... 5
2.1 Information Technology in Higher Education ... 5
2.2 Mobile Learning ... 5
2.2.1 Defining mobile learning ... 6
2.2.2 Mobile Learning Characteristics... 6
2.2.3 Mobile Learning Potential ... 7
2.2.4 M-learning Limitations ... 8
2.3 Factors that may influence the mobile campus adoption ... 8
2.3.1 The Diffusion of innovation Model: ... 9
2.3.2 Other attribute: ... 10
2.3.3 Technology Acceptance Model (TAM): ... 10
2.3.4 Valued based Adoption Model (VAM): ... 12
2.3.5 Social Influence (SI): ... 12
3 Methodology ... 13
3.1 Sample: ... 14
3.2 Data collection ... 14
3.3 Material used in the research ... 15
3.3.1 Concept board with the description of MyCatolica App: ... 15
3.4 Research Guide: ... 15
4 Results and Analysis ... 17
4.1 Sample profile ... 17
4.2 Results: ... 18
4.3 Part One: Current image of Moodle and MyCatolica’s awareness ... 18
4.4 Part Two: Evaluating the domains that could affect the adoption of MyCatolica ... 19
4.4.1 Compatibility ... 19
4.4.2 Relative advantage ... 20
4.4.3 Perceived value ... 20
4.4.4 Trialability ... 21
4.4.5 Complexity / ease of use ... 21
4.4.6 Resistance ... 22
4.4.7 Observability / Social Influence ... 23
viii
4.5 Part three: Exploratory phase ... 24
4.5.1 STAYS ... 25 4.5.2 EVENTS ... 27 4.5.3 FLEAMARKET ... 28 4.5.4 CHAT ... 29 4.5.5 CLOUD ... 30 4.5.6 NOTE ... 31 4.5.7 Closing questions ... 31 4.6 Discussion of results: ... 32
4.6.1 RQ1) What are the differences perceived between the traditional education management website system (Moodle, ESCA and Catolica Business School’s website) and the mobile campus (MyCatolica)? ... 32
4.6.2 RQ2) What are the values and opportunities students expect to obtain by adopting the mobile campus?...33
RQ3) What are the barriers that currently influence users adoption of Catolica Business School’s Mobile Campus? ... 33
4.6.3 RQ4) What type of features can help to overcome the barriers of adoption? ... 34
5 Conclusion ... 37
ix
List of figures:
Figure 1 – MyCatolica’s Features ... 15
Figure 2 - Stays' Mockup ... 25
Figure 3 - Events' Mockup ... 27
Figure 4 - FleaMarket's Mockup ... 28
Figure 5 - Chat's Mockup ... 29
Figure 6 - Cloud's Mockup ... 30
xi
List of Appendixes:
Appendix 1 - Table of Dimensions ... 45
Appendix 2 - Research Guide ... 46
Appendix 3 - Moodle's perception and MyCatolica awareness ... 52
Appendix 4 - Compatibility Domain transcript ... 52
Appendix 5 - Relative Advantage Domain transcript ... 53
Appendix 6 - Perceived Value Domain transcript ... 54
Appendix 7 - Triability Domain transcript ... 54
Appendix 8 - Complexity and Ease of Use Domains transcript ... 55
Appendix 9 - Resistance Domain transcript ... 55
Appendix 10 - Observability & Social Influence Domain transcript... 56
Appendix 11 - Perceived Usefulness Domain Transcript ... 56
Appendix 12 - Desired Features transcript - Exploratory phase ... 57
Appendix 13 - STAYS transcript ... 57
Appendix 14 - EVENTS transcript ... 58
Appendix 15 - FLEA MARKET transcript... 59
Appendix 16 - CHAT transcript ... 60
Appendix 17 - CLOUDS transcript ... 60
Appendix 18 - CHAT Transcript ... 61
Appendix 19 - Closing questions transcript ... 61
List of table Table 1 - Participants ... 18
1
,QWURGXFWLRQ
&RPSDQLHVDUHLQFUHDVLQJO\UHTXLUHGWRHQKDQFHWKHLUDELOLW\WRLQQRYDWHDQGDGDSWWR FKDQJHVLQWKHH[WHUQDOHQYLURQPHQWLQRUGHUWRDFKLHYHFRPSHWLWLYHVXFFHVV(OL]DEHWK 0DU\ 7RPDQDJHWKLVWKH\QHHGWRXQGHUVWDQGWKHFKDOOHQJHVLQWURGXFHGE\WKHWHFKQRORJLFDO LQQRYDWLRQVDQGGHYHORSQHZFRPSHWHQFHVWRRYHUFRPHWKHVH+HQGHUVRQ &ODUN7XVKPDQ $QGHUVRQ(OL]DEHWK 0DU\:LWKLQWKLVFRQWH[WWKHDGYDQFHPHQWRIPRELOH QHWZRUNVVSHHGDQGFRYHUDJHKDYHWULJJHUHGWKHDGRSWLRQRIVPDUWSKRQHVWDEOHVDQGRWKHU ZLUHOHVVJDGJHWVFKDQJLQJWKHG\QDPLFVRIEXVLQHVVDQGWKHZD\ZHUHODWHWRWKHZRUOG ,QWKHFRQWH[WRI8QLYHUVLWLHVZHKDYHVHHQWKHVHG\QDPLFFKDQJHVKDSSHQLQJZKHQ FRPSXWHUVDQGFRPPXQLFDWLRQWHFKQRORJ\ZHUHILUVWLQWURGXFHGDVDFODVVURRPWRRO%DVHGRQWKDW LWLVUHDVRQDEOHWRH[SHFWE\WKHLQFUHDVLQJO\VSUHDGRIPRELOHWHFKQRORJLHVWKDWWKHPRELOH QHWZRUNSKHQRPHQRQPD\IRVWHUDVLPLODUHIIHFWRQWKHZD\HGXFDWLRQLVGHOLYHUHG0DKD +HED 3HWHU ,QWHUQHWDQG0RELOH'HYLFHV*URZWK ,QWKHODVWGHFDGHZHZLWQHVVHGDFRQVLVWHQWJURZWKRILQWHUQHWXVDJHIURPRIWKH SRSXODWLRQLQWRLQUHFHQW\HDUV,QWHUQHW:RUOG6WDWV&KHRQHWDO0RUH DQGPRUHWKHXVHRIWKH,QWHUQHWLVEHFRPLQJLPPHUVHGLQFRQVXPHUV¶OLIH7KLVLVDOVRKDSSHQLQJ EHFDXVHRIWKHEURDGHUGDLO\XVHRIVPDUWSKRQHVDQGDOOVRUWVRISRUWDEOHGHYLFHVZKLFKDUHDOWHULQJ WKHZD\ZHOLYHDQGWKHZD\ZHOHDUQ$EGXOODK 6LUDM&KHRQHWDO $GGLWLRQDOO\VPDUWSKRQHVWKURXJKWKHLUFRPSXWHUOLNHIXQFWLRQDOLW\LQWHUQHWDFFHVVDQG SRUWDELOLW\EHFDPHZLGHVSUHDGUHDFKLQJDSHDNDIWHUWKHUHOHDVHRIWKHILUVWL3KRQHLQE\ $SSOH'DHMRRQJHWDO,QIDFWDIWHUWKHJURZWKRILWVXVDJHZDVVLJQLILFDQWDVLW FKDQJHGQRWRQO\LQWHUSHUVRQDOVKRUWFRPPXQLFDWLRQH[FKDQJHVEXWDOVRWKHPHWKRGVRI LQIRUPDWLRQVHDUFKDQGWKHRYHUDOOFRQVXPHUEHKDYLRU*HRUJH+HQFHPRELOHGHYLFHVKDYH XQGRXEWHGO\EHFRPHSDUWRIHYHU\RQH¶VOLIH ,QGHYHORSHGFRXQWULHVWKHSHQHWUDWLRQRIPRELOHGHYLFHVZHQWRYHUSHUSHUVRQZLWK VRPHRIWKHPRZQLQJPRUHWKDQRQHGHYLFH+DUWPXW 9LVZDQDWK8VHUVFKRRVHWRXVH WKHPIRUGLIIHUHQWUHDVRQVVXFKDV³WUDGLWLRQDO´SKRQHFDOOVYLVLWLQJZHEVLWHVFKHFNLQJHPDLOV FDOHQGDUVFKHGXOLQJZULWLQJSHUVRQDOQRWHVZDWFKLQJYLGHRVPDSVJDPHVDQGPDQ\RWKHU2 IHDWXUHV7KHVHNLQGVRIIHDWXUHVKDYHPDGHWKHDERYHPHQWLRQHGGHYLFHVLQFUHDVLQJO\SRSXODURYHU WKHWUDGLWLRQDOODSWRSV1R]KD7UXRQJ :KHQLWFRPHVWRDFDGHPLDLQ$&5/5HVHDUFK3ODQQLQJDQG5HYLHZ&RPPLWWHH VKRZVWKDWLQ8QLWHG6WDWHVRIXQGHUJUDGXDWHVKDYHVPDUWSKRQHVL3RGVDQGWDEOH GHYLFHVDQGQRWVXUSULVLQJO\PRUHWKDQXVHWKHLUGHYLFHVIRUDFDGHPLFUHODWHGLVVXHV<DQ 6DUDK:KHUHE\(OPRUHDQG6WHSKHQVKLJKOLJKWWKDWDFDGHPLFOLEUDULHVFDQQRWDIIRUG WRLJQRUHWKLVPOHDUQLQJWUHQGPRELOHGHYLFHVKROGWKHSRWHQWLDOIRUQHZZD\VRIOHDUQLQJDQG LQQRYDWLYHLQWHUDFWLRQVEHWZHHQVWXGHQWDQGDFDGHPLFLQVWLWXWLRQV 7KXVLQWKHHGXFDWLRQFRQWH[WLWKDVH[SHULHQFHGDVKLIWIURPHOHDUQLQJOHDUQLQJWKDWLV FDUULHGWKURXJKHOHFWURQLFPHGLDFRPPRQO\RQLQWHUQHWWRPOHDUQLQJOHDUQLQJWURXJKPHGLDDQG VRFLDOLQWHUDFWLRQXVLQJRZQHOHFWURQLFPRELOHGHYLFHV7KHUDSLGVSUHDGRIPRELOHGHYLFHVDPRQJ DFDGHPLDVWXGHQWVLVDFXUUHQWUHDOLW\DOODURXQGWKHZRUOG)RULQVWDQFHHYHQLQGHYHORSLQJ FRXQWULHVVXFKDV*KDQDWKHUHLVDKLJKUDWHRIPRELOHSKRQHDPRQJVWXGHQWV$QGWKLVKLJKUDWHRI DGRSWLRQKDVPRWLYDWHGWKH8QLYHUVLW\RI*KDQDWRODXQFKLWV,QWHJUDWHG'LJLWDO0RELOH/HDUQLQJ 3ODWIRUPIRU'LVWDQFH(GXFDWLRQ,'03LQRUGHUWRWDNHIXOODGYDQWDJHRIWKHPRELOHGHYLFHVIRU HGXFDWLRQDOSXUSRVHV7KHLUDLPLVWRSURYLGHFRXUVHPDWHULDOVWRDLGWKHHGXFDWLRQDOSURJUHVVRI GLVWDQFHHGXFDWLRQVWXGHQWV0LFKDHO (OOHQ 7KHHUDRI6RFLDO0HGLD 7KHHPHUJHQFHRI6RFLDO0HGLDLQWURGXFHGJUHDWRSSRUWXQLWLHVIRUDOOLQYROYHG,WKDV EURXJKWQHZEHQHILWVIRULWVXVHUVDOORZLQJWKHPWRSDUWLFLSDWHDQGJLYHRSLQLRQVRSHQWKHPVHOYHV WRQHZKRUL]RQVFROODERUDWHDQGH[FKDQJHLQIRUPDWLRQPDLQWDLQGLDORJXHZLWKRWKHUXVHUVWREXLOG DFRPPXQLW\EDVHGRQVLPLODULQWHUHVWVDQGWRLQWHUFRQQHFWZLWKRWKHUZHEVLWHVRUUHVRXUFHV1R]KD 7KHEHQHILWVRIEHLQJSDUWRIDVRFLDOQHWZRUNEHQHILWVERWKWKHXVHUDQGWKHFRPSDQ\)RU WKHXVHULWKDVHPSRZHUHGFRPPXQLFDWLRQIDFLOLWDWLQJFRQWLQXRXVLQWHUDFWLRQ1R]KD)RU FRPSDQLHVLWHQKDQFHVWKHLQWHUFRQQHFWLYLW\ZLWKFRQVXPHUVZLWKSRVLWLYHLPSDFWRQWUXVW:XHW DO+DMOLDQGVRFLDOLQWHUDFWLRQ+DMOL
3 0RELOHDSSOLFDWLRQVLQWKH(UDRI6RFLDO0HGLD 7KURXJKWKH\HDUVDORQJVLGHZLWKWKRVHWUHQGVWKHWHFKQRORJLHVIHDWXUHGLQPRELOHSKRQHV KDYHEHFRPHPRUHVRSKLVWLFDWHGSURYLGLQJXVHUVDELJYDULHW\RIQHZDSSOLFDWLRQV,QIDFW$SSOH VWRUHKDVPRUHWKDQPLOOLRQDSSOLFDWLRQVDQGE\0D\WKHUHKDGDOUHDG\EHHQUHJLVWHUHGRYHU ELOOLRQGRZQORDGVIRUWKHH[LVWLQJDSSOLFDWLRQV7KLVWUHQGSUHGRPLQDQWO\VXSSRUWVWKHYLWDO LPSRUWDQFHIRURUJDQL]DWLRQVWRLQWHJUDWHPRELOHDSSOLFDWLRQVLQWRWKHLUVWUDWHJLHVDQGVHUYLFHV +DUWPXW 9LVZDQDWK 7KHDGYDQWDJHVWKDWKHOSIRVWHULQJWKHDGRSWLRQRIPRELOHWHFKQRORJLHVDUHDOVRWUDQVIHUDEOH WRKLJKHUHGXFDWLRQDVWKH\FDQDOVRKHOSRQSURYLGLQJQHZHGXFDWLRQDOYDOXHV,WLVH[WHQVLYHO\ UHFRJQL]HGWKHWUDQVIRUPDWLYHSRZHURIPOHDUQLQJLQKLJKHUHGXFDWLRQWRERRVWWHDFKLQJDQG OHDUQLQJ,WLVDFNQRZOHGJHGWKDWPRELOHWHFKQRORJLHVDUHFKDQJLQJWKHUXOHVRIKRZVWXGHQWVUHODWH WRDFDGHPLFVXSSRUWLQJPDWHULDOV0LFKDHO (OOHQ 1HYHUWKHOHVVGHVSLWHWKHEHQHILWVWKHDGRSWLRQRIXQLYHUVLWLHVPRELOHDSSOLFDWLRQVE\ VWXGHQWVVWLOOQHHGVIXUWKHUXQGHUVWDQGLQJ,QRUGHUWRDGGUHVVWKDWWKHFXUUHQWGLVVHUWDWLRQDLPVWR DQDO\]HDQGH[SORUHWKHIDFWRUVWKDWKHOSSRVLWLYHO\LQIOXHQFHDQGIDFLOLWDWHWKHVWXGHQW¶VDGRSWLRQ RIDPRELOHXQLYHUVLW\DSSOLFDWLRQ 3UREOHP6WDWHPHQW )ROORZLQJWKHWUHQGXQLYHUVLWLHVDUHLQFUHDVLQJO\LPSOHPHQWLQJWKHPRELOHFDPSXVDVDQHZ HGXFDWLRQDOWRRO,Q3RUWXJDOWKHWKUHHPRVWLPSRUWDQWEXVLQHVVVFKRROVKDYHDOUHDG\ODXQFKHGWKHLU PRELOHSODWIRUPVDQGDUHLQYHVWLQJRQLWVGLVVHPLQDWLRQDPRQJVWXGHQWV1HYHUWKHOHVVWKHDGRSWLRQ LVVWLOODWLWVHDUO\SKDVHGHVSLWHWKDWXQLYHUVLWLHVHIIRUWVWRPDWFKWKHVHUYLFHVRIIHUHGE\DWWKHLU ZHEVLWHSODWIRUPV3UHYLRXVVWXGLHVWKDWKDYHDQDO\]HGWKHDGRSWLRQRI/HDUQLQJ0DQDJHPHQW 6\VWHP/06LQXQLYHUVLWLHVKDYHUHFRPPHQGHGWRIXUWKHUH[SORUHWKHWULJJHUVEHKLQGDGRSWLRQ WKURXJKDPRUHLQGHSWKVWXG\ZKLFKFRXOGEULQJPRUHUHOHYDQWLQVLJKWV+DQ +DQ 7KHUHIRUHWKHDLPRIWKHFXUUHQWVWXG\LVWRH[SORUHLQGHSWKWKHLQIOXHQFLQJIDFWRUVWKDWPD\ LPSDFWVWXGHQWVDGRSWLRQRIPRELOHFDPSXV)RUWKDWWKHUHVHDUFKKDVIRFXVHGRQWKHPRELOH FDPSXVDW&DWyOLFD/LVERQ6FKRRORI%XVLQHVVDQG(FRQRPLFV0\&DWROLFDZDVODXQFKHGDWWKHHQG RILQSDUWQHUVKLSZLWK0RRIZG,QLWVLQLWLDOSKDVHLWZDVDGYHUWLVHGLQWHUQDOO\WRVWXGHQWV WKURXJKIO\HUV&XUUHQWO\VWXGHQWVDUHSUHVHQWHGWR0\&DWROLFDRQWKH:HOFRPH'D\
4 7KHFXUUHQWVWXG\HQYLVLRQVWRXQGHUVWDQGZKLFKDUHWKHIDFWRUVH[SHFWDWLRQVYDOXHVDQG EHQHILWVZKLFKFDQSRVLWLYHO\LPSDFWWKHDGRSWLRQIURPXVHUVSHUVSHFWLYH,QRUGHUWRFRPHRXW ZLWKUHOHYDQWUHVXOWVWKHWKHVLVZLOOIROORZWKHW\SLFDODSSURDFKRIDQH[SORUDWRU\UHVHDUFKZLWKDQ LQGHSWKLQWHUYLHZV7KLVPHWKRGRIUHVHDUFKZLOODOORZWRGLUHFWO\LQWHUDFWZLWKWKHXVHUVRU SRWHQWLDOXVHUV 5HVHDUFK2EMHFWLYHV 5HVHDUFKJDS'HVSLWHWKHHIIRUWVRIXQLYHUVLWLHVLQFRPPXQLFDWLQJWKHLUPRELOHDSSV VWXGHQWVDGRSWLRQLVVWLOOLQLWVLQLWLDOSKDVH)XUWKHUXQGHUVWDQGLQJLVQHHGHGLQRUGHUWRDFFHOHUDWH WKHSURFHVVRIDGRSWLRQ+RZHYHUVWXGLHVRQWKLVVSHFLILFWRSLFDUHYHU\VFDUFHHVSHFLDOO\LQD (XURSHDQFRQWH[W7KHFXUUHQWUHVHDUFKLQWHQGVWRILOOLQWKLVJDSE\LGHQWLI\LQJDQGH[SORULQJWKH IDFWRUVWKDWLQIOXHQFHWKHPRELOHFDPSXVDGRSWLRQ 5HVHDUFKTXHVWLRQV 54:KDWDUHWKHGLIIHUHQFHVSHUFHLYHGEHWZHHQWKHWUDGLWLRQDOHGXFDWLRQ PDQDJHPHQWZHEVLWHV\VWHP0RRGOH(6&$DQG&DWROLFD%XVLQHVV6FKRRO¶VZHEVLWH DQGWKHPRELOHFDPSXV0\&DWROLFD" 54:KDWDUHWKHYDOXHVDQGRSSRUWXQLWLHVVWXGHQWVH[SHFWWRREWDLQE\DGRSWLQJ WKHPRELOHFDPSXV" 54:KDWDUHWKHEDUULHUVWKDWFXUUHQWO\LQIOXHQFHXVHUVDGRSWLRQRI&DWROLFD %XVLQHVV6FKRRO¶V0RELOH&DPSXV" 54:KDWW\SHRIIHDWXUHVFDQKHOSWRRYHUFRPHWKHEDUULHUVRIDGRSWLRQ"
5
/LWHUDWXUHUHYLHZ
,QIRUPDWLRQ7HFKQRORJ\LQ+LJKHU(GXFDWLRQ )LUVWRIDOO,QIRUPDWLRQ7HFKQRORJ\HQDEOHVPRUHHIILFLHQWDGPLQLVWUDWLYHSURFHVVHVWKDW SURYLGHEHWWHUFRPPXQLFDWLRQDQGFROODERUDWLRQEHWZHHQWKHHQWLWLHV7KLVHPSRZHUVRUJDQL]DWLRQDO WHFKQRORJ\DQGKDVVWURQJEHQHILWVIRUKLJKHUHGXFDWLRQ)XUWKHUPRUH,7FDQEHXVHGDVDOHDUQLQJ WHFKQRORJ\DQGEHFRPHSDUWRIWKHOHDUQLQJDVZHOODVHQDEOHWKHPDQDJLQJDQGWHDFKLQJSURFHVVHV LQVLGHWKHKLJKHUHGXFDWLRQFRPSOH[V\VWHPV*UHJRU\)DFXOWLHVQHHGEHWWHURUJDQL]DWLRQDO WHFKQRORJ\DQGEHWWHUHIILFLHQF\LQWKHLUV\VWHPV6RPHWKLQJWKDWVXSSRUWVSURFHVVHVDVHQUROOPHQW LQVWUXFWLRQVFHUWLILFDWLRQVDQGVRFLDOL]DWLRQV3OXVDQDSSOLFDWLRQWKDWFDQEHWWHUH[SORLWWKH,7 DGYDQWDJHVLQFUHDVLQJWKHHGXFDWLRQDOSURGXFWLYLW\ $GPLQLVWUDWLRQVLQ+LJKHUHGXFDWLRQV\VWHPVUHTXLUHQRWMXVWKXPDQUHVRXUFHVVFKHGXOLQJ DQGDSK\VLFDOVSDFHOLNHSODQWVDQGRIILFHVEXWDOVRDFDGHPLFUHVRXUFHVIRUVWXGHQWVDQG SURIHVVRUVWRFROOHFWWKHLUH[SHULHQFH,QIRUPDWLRQWHFKQRORJ\KDVDOORZHGWKHPWRLPSURYH HIILFLHQF\LQDGPLQLVWUDWLRQE\HOLPLQDWLQJSDSHUEDVHGGRFXPHQWDWLRQLPSURYLQJVFKHGXOLQJ DFFHVVDQGKDYLQJDPRUHFRVWHIIHFWLYHKXPDQUHVRXUFH%\LQWURGXFLQJDQDO\WLFVDQGELJGDWDWKH 8QLYHUVLW\KDVWKHRSSRUWXQLW\WREHWWHUFROOHFWDQDO\]HDQGXQGHUVWDQGLQSXWVDVZHOODVLPSURYH WKHLUDGPLQLVWUDWLRQ*UHJRU\7KHUHE\RQHRIWKHDGYDQWDJHVRI,QIRUPDWLRQ7HFKQRORJ\LV WKDWHQDEOHVE\LWVZLGHUGDWDEDVHVWXGHQWVWRDFFHVVLQIRUPDWLRQRQWKHJR)RULQVWDQFHVPRELOH OHDUQLQJLVDWHUPLPSOLHGE\2¶0DOOH\HWDOZKLFKUHIHUVWRWKHOHDUQLQJSURFHVVWRKDSSHQ HYHQZKHQWKHOHDUQHUVDUHQRWLQDSUHDUUDQJHGORFDWLRQDQGDOVRLPSURYHVWKHLUVWXG\ZKHQ OHDUQHUVEHQHILWIURPOHDUQLQJRSSRUWXQLWLHVSURYLGHGE\DPRELOHWHFKQRORJ\1R]KD OHDUQHUVEHQHILWIURPOHDUQLQJRSSRUWXQLWLHVSURYLGHGE\DPRELOHWHFKQRORJ\1R]KD 0RELOH/HDUQLQJ 6RPHH[SORUDWRU\UHVHDUFKHVVKRZHGKRZPOHDUQLQJLIFRUUHFWO\GHVLJQHGFRXOGEHDWRRO WRHQJDJHVWXGHQWVDQGWRWHDFKVNLOOVLQWHOOHFWLYHDQGFRQFHSWV(O%LVKRXW\HWDO3XUVHOO (QYLVLRQLQJWRH[SORUHWKDW8QLYHUVLWLHVDUHDOUHDG\LPSOHPHQWLQJWKHLUHIIRUWVE\PHDQVRI WZREDVHVWUDWHJLHVQDPHO\H[SDQGLQJWKHZHEVLWHYHUVLRQVLQWRDPRELOHYHUVLRQRUFUHDWLQJD GHGLFDWHGDSSOLFDWLRQWKDWLVDYDLODEOHLQDQDSSOLFDWLRQVWRUH7KHUHLVWKHH[DPSOHRIDODUJH
6 XQLYHUVLW\LQ8QLWHG6WDWHVZKLFKPDQDJHWRSURYLGHVWXGHQWVZLWKLQWXLWLYHHDV\DFFHVVWRRQOLQH FRXUVHVZKHUHVWXGHQWVFRXOGFRPSOHWHWDVNVUHDGSRVWRQIRUXPVZULWLQJMRXUQDOVDQGFKHFN JUDGHVDQGDVVLJQPHQWV7KHXQFRPSOLFDWHGDQGLPPHGLDWHDFFHVVLELOLW\RIOHDUQLQJFRQWHQWWKURXJK ZHEVLWHVRUDSSV±ZKLFKDUHUHDGLO\DYDLODEOHWREHGRZQORDGHGLQDSSOLFDWLRQVWRUHVKDYH HQKDQFHGWKHIUHTXHQF\RIVWXGHQW¶VHQJDJHPHQWZLWKDFDGHPLFFRQWHQWDQGWKXVSURPRWHGDKLJKHU TXDOLW\OHDUQLQJ%DL\XQ([DPSOHVOLNHWKHVHVKRZVKRZYDOXDEOHFRXOGEHDQDSSURSULDWH LQWURGXFWLRQRIDPRELOHOHDUQLQJWRRO 'HILQLQJPRELOHOHDUQLQJ 0RELOHOHDUQLQJKDVVXIIHUHGDIHZFKDQJHVLQWHUPVRIZKDWLWPHDQV7KHODWHVWGHILQLWLRQ SXUSRVHGE\$OO\DQG3ROODUD .HH%URXVVDUGZDV³WKHSURFHVVRIXVLQJDPRELOH GHYLFHWRDFFHVVDQGVWXG\OHDUQLQJPDWHULDOVDQGWRFRPPXQLFDWHZLWKIHOORZVWXGHQWVLQVWUXFWRUV RULQVWLWXWLRQ´$GGLWLRQDOO\:H[OHUHWDOGHILQLWLRQEURDGHQVPRELOHOHDUQLQJWRDQ\ DFWLYLW\WKDWSHUPLWVLQGLYLGXDOVWREHPRUHSURGXFWLYHZKHQFRQVXPLQJLQIRUPDWLRQ$O =DKUDQL 0RELOH/HDUQLQJ&KDUDFWHULVWLFV $YHU\LPSRUWDQWFKDUDFWHULVWLFRIPOHDUQLQJQRWHGE\.XNXOVND+XOPHHWDOLVWKDW LWWXUQVWKHWUDGLWLRQDOZD\RILGHQWLI\LQJOHDUQLQJDVH[FOXVLYHWRXQLYHUVLW\WLPHLQWRDQLQIRUPDO XQFRPSOLFDWHGDQGSHUVRQDOL]HGZD\RIOHDUQLQJ,QVWHDG1DLVPLWKHWDOGLVWLQJXLVKHVILYH GLIIHUHQWOHDUQLQJSURFHVVHVDVVRFLDWHGWRLQFRUSRUDWLQJPRELOHWHFKQRORJLHVEHKDYLRULVWOHDUQLQJ FRQVWUXFWLYLVWOHDUQLQJFROODERUDWLYHOHDUQLQJVLWXDWHGOHDUQLQJDQGLQIRUPDOOHDUQLQJ %HKDYLRUDOOHDUQLQJPRWLYDWHVVWXGHQWVE\WDNLQJDGYDQWDJHRIWKHIDVWV\VWHPIHHGEDFN ORRSPHDQLQJWKDWLWFDQSURYLGHWKHVROXWLRQVWRWKHSUREOHPVWKDWVWXGHQWVWU\WRDQVZHUMXVWOLNH DUHZDUG&RQVWUXFWLYLVWOHDUQLQJKDSSHQVZKHQVWXGHQWVFRQVWUXFWQHZFRQFHSWVE\FRPELQLQJ PRELOHGHYLFHVFDSDELOLWLHVDQGSULRUNQRZOHGJH6LWXDWHGOHDUQLQJLVZKHQVWXGHQWVFDQXVH PRELOHVUHVRXUFHVWRFROOHFWLQIRUPDWLRQDQGOHDUQDERXWWKHHQYLURQPHQWRQWKHJR&ROODERUDWLYH OHDUQLQJWDNHVDGYDQWDJHRIKRZXVHUVFDQLQVWDQWO\FRPPXQLFDWHZLWKHDFKRWKHUDQGLQGRLQJVR QHZLGHDVIRUPDQGJURZ±WKHOHDUQLQJGRQHRXWVLGHRIWKHDFDGHPLDFDQEHFROODERUDWLYHDQGQRW
7 RQO\LQGLYLGXDO7KH,QIRUPDOOHDUQLQJLVWKHOHDUQLQJDFFRPSOLVKHGRXWVLGHRIWKHDFDGHPLD HQYLURQPHQWWKXVKDVWKHDGYDQWDJHRIOHYHUDJLQJDQ\WLPHRXWVLGHWKHIRUPDOLQVWLWXWLRQDQGXVH WKDWOHDUQLQJLQWKHFODVVURRP $GGLWLRQDOO\.XNXOVND+XOPHHWDOEULOOLDQWO\UHVXPHVZK\POHDUQLQJLVVR WUDQVIRUPDWLYHEHFDXVHWKHVHOHDUQLQJH[SHULHQFHVWUDQVFHQGVSDWLDOWHPSRUDODQGFRQFHSWXDO ERUGHUVZKLFKGUDPDWLFDOO\FKDOOHQJHWKHDVVXPSWLRQVRIKRZOHDUQLQJFDQEHDFFRPSOLVKHG %HVLGHV.XNXOVND+XOPHSUHYLRXVO\QRWHGWKDWWKHLPSURYHPHQWLQDFFHVVWKHSRWHQWLDOIRU DSDUDGLJPVKLIWLQWHDFKLQJDQGOHDUQLQJDUHZKDWPDNHVPOHDUQLQJJURXQGEUHDNLQJ 0RELOH/HDUQLQJ3RWHQWLDO 9DULRXVEHQHILWVDUHLQWURGXFHGE\WKH0RELOH/HDUQLQJ&RQFHUQLQJWKDW4XLQQ SURSRVHGWKHIRXU&¶VZKLFKWHDFKHUVDQGVWXGHQWVFRXOGEHQHILWIURPXVLQJPRELOHV\VWHPV FRQWHQWFRPSXWHFDSWXUHDQGFRPPXQLFDWH&RQWHQWUHIHUVWRWKDWZKDWVWXGHQWVFDQUHDGZDWFK DQGOLVWHQRIDFDGHPLFUHODWHGFRQWHQW&RPSXWHPHDQVWKDWWKHVWXGHQWVFDQGLUHFWO\SURFHVV FDOFXODWLRQVLQWKHVDPHGHYLFHWKH\DFTXLUHFRQWHQW&DSWXUHPHQWLRQVWKHFDSDFLW\RIPRELOH GHYLFHVWRFROOHFWDXGLRYLGHRDQGLPDJHVIURPWKHHQYLURQPHQWDQGODVWO\&RPPXQLFDWHZKLFK LPSOLHVWKDWVWXGHQWVFDQFRPPXQLFDWHZLWKRWKHUSHHUVDQGWHDFKHUVWKURXJKDQ\IRUPRIFRQWHQW DXGLRYLGHRRULPDJHV$O=DKUDQL 2QFHPRUHWKHODUJHDGRSWLRQRISRUWDEOHGHYLFHVPRWLYDWHGWKHHGXFDWLRQDOLQVWLWXWLRQVWR PDNHDELJHIIRUWRQGHYHORSLQJPRELOHFDPSXVZKLFKVXSSRUWVDFDGHPLFVRFLDODQG DGPLQLVWUDWLYHLVVXHV8QLYHUVLW\$SSOLFDWLRQLQFUHDVHVWKHSRZHUDFFHVVWRFRQWHQWVDFWLYLWLHV PHGLDFRQWHQWVDQGLQFUHDVHVWKHV\QHUJ\LQVLGHRILW+DQ +DQ(YHQLIWKHPRELOH OHDUQLQJKDVWKHSRVVLELOLW\WRHQKDQFHLPSURYHDQGUHLQIRUFHHGXFDWLRQZLWKHODVWLFDFFHVVIDVWHU FRPPXQLFDWLRQDQGDGGLWLRQDOOHDUQLQJPDWHULDOVWKHUHDUHRWKHUUHOHYDQWDVSHFWVWKDWLPSDFWWKH LPSOHPHQWDWLRQVXFKDVWKHUHDGLQHVVRIWKHLQVWLWXWLRQRI+LJKHUHGXFDWLRQWRDGRSWWKLVQHZ WHFKQRORJ\WRRO$O0XVKDVKD&KHRQHWDO0RVWXQLYHUVLWLHVRIIHUWKHLUPRELOH FDPSXVIRUIUHHEXWXVXDOO\WKHVHUYLFHVDUHQRWFXVWRPL]HGIRUVWXGHQWVQHHGVDQGWKH\PHUHO\ UHSOLFDWHWKHIXQFWLRQDOLWLHVRIWKHZHEVLWHFDPSXV&KHRQHWDO,QYLHZRIWKDWLWLVHVVHQWLDO WRLGHQWLI\ZKLFKIXQFWLRQVDQGRSHUDWLRQDUHUHPDUNDEO\LPSRUWDQWIRUWKHVWXGHQWSULRUWRDQ\ RWKHUVWRHQVXUHDTXDOLW\HGXFDWLRQDOH[SHULHQFHIRUWKHXVHU7KHVHTXHVWLRQVVKRXOGEH
8 FRQWHPSODWHGLQWKHHDUO\VWDJHVRIGHVLJQLQRUGHUWRGHILQHFRQJUXHQWVWUDWHJ\ZKLOHEXLOGLQJDQG GHYHORSLQJWKHPOHDUQLQJDSSOLFDWLRQ7KHGHVLJQRIPOHDUQLQJPRELOHSOD\VDQLPSRUWDQWUROHRQ LQFUHDVLQJWKHLUHIIHFWLYHQHVVDVHGXFDWLRQDOPDWHULDO7KHGHVLJQVKRXOGEHSODQQHGLQRUGHUWR RSWLPL]HWKHOHDUQLQJH[SHULHQFH$O=DKUDQL([DPSOHVRIFRQFHSWVWRFRQVLGHUDUHFRORUV LQWHUIDFHOD\RXWDQGWKHRYHUDOODWWUDFWLYHQHVVRIWKHDSSOLFDWLRQZKLFKKDYHDPDMRULQIOXHQFHLQ XVHU¶VDGRSWLRQDQGXVDJH.DPDUX]DPDQ =DLQRO6FUHHQVL]HVKRXOGEHGLYLGHGLQPHQX QDYLJDWLRQDUHDDQGFRQWHQW'DUFH\ &RQGHUFROXPQVPDUJLQVDQGLFRQVQDYLJDWLRQ EXWWRQVVKRXOGEHFRQVLVWHQWO\LQWKHVDPHSODFHLQHYHU\VFUHHQVRWKHXVHULVFDSDEOHRI XQGHUVWDQGLQJDOOVFUHHQV.LPHWDO&RORUVVKRXOGEHXVLQJVSDULQJO\DQGVWUDWHJLFDOO\WR FRPSOHPHQWLQIRUPDWLRQEXWLQPRGHUDWLRQQRWWRFRQIXVHWKHXVHU$OTDKWDQL 0OHDUQLQJ/LPLWDWLRQV (YHQWKRXJKWKHUHLVJUHDWSRWHQWLDOLQPOHDUQLQJLWLVQRWJXDUDQWHHGWKHDXWRPDWLF DGRSWLRQRIWKHVHWHFKQRORJLHVDV'\VRQHWDOSRLQWHGRXW7KHUHLVDGLIIHUHQFHEHWZHHQD PRELOHWHFKQRORJ\EHLQJPDGHDYDLODEOHDQGXQGHUVWDQGLQJKRZWKHDGRSWLRQRIWKDWWHFKQRORJ\ UHDOO\ZRUNV)RULQVWDQFHDWHDFKHUVKRXOGEHDEOHWRZRUNHIIHFWLYHO\ZLWKWKHVHWHFKQRORJLHV KRZHYHU3ROODUDGLVFRYHUHGWKDWPRUHWKDQKDOIRIWHDFKHUVKDGDODFNRILQWHUHVWDQGRI SURILFLHQF\ZKHQXVLQJPGHYLFHV1HYHUWKHOHVV.XNXOVND+XOPHVXJJHVWVWKDWKLJKHU HGXFDWLRQSURIHVVLRQDOVFDQDGDSWWRWKHVHDGYDQFHPHQWVLQWHFKQRORJ\E\DVVLVWHGWUDLQLQJLQRUGHU WREHFRPHPRUHNQRZOHGJHDEOH2QWKHRWKHUKDQG*HRUJLHYHWDOEHOLHYHVWKDWPOHDUQLQJ WHFKQRORJLHVZLOOEHFRPHPRUHSRSXODULQWKHORQJUXQLQVSLWHRIWKHLUFXUUHQWVHWEDFNV 1HYHUWKHOHVVLWFDQQRWEHGHQLHGWKDWWKHUHDUHFKDOOHQJHVLQWKHDGRSWLRQRIPRELOHWHFKQRORJLHV HVSHFLDOO\LQDFDGHPLDHQYLURQPHQWV$O=DKUDQL HVSHFLDOO\ )DFWRUVWKDWPD\LQIOXHQFHWKHPRELOHFDPSXVDGRSWLRQ ,QWKLVGLVVHUWDWLRQWKHLQQRYDWLRQLVWKH/HDUQLQJ0RELOH6\VWHPZKLFKLVEHFRPLQJPRUH ZLGHVSUHDGLQWKHKLJKHUHGXFDWLRQ7KHQDVHUYLFHVXSSOLHUPXVWNQRZZKDWDUHWKHIDFWRUVWKDW PD\LQIOXHQFHVWXGHQWV¶DGRSWLRQWRFRQWULEXWHIRUDEHWWHUGHFLVLRQPDNLQJSURFHVV
9 ,QSUHYLRXVVWXGLHVWRHYDOXDWHWKHDVSHFWVLQYROYHGLQWKHDGRSWLRQSURFHVVRIQHZ WHFKQRORJLHVGLIIHUHQWPRGHOVZHUHXVHGDSSOLHG+HQFHVRPHRIWKHPZHUHVHOHFWHGWRGHYHORS WKLVGLVVHUWDWLRQ$QLPSRUWDQWVHFWLRQRIWKHUHVHDUFKLVGHGLFDWHGWRWKH'LIIXVLRQRI,QQRYDWLRQ PRGHO'2,ZKLFKLVRQHRIILUVWWKHRULHVWKDWWU\WRH[SODLQKRZDQHZWHFKQRORJ\DFKLHYHV PRPHQWXPDQGVSUHDGVWKURXJKDSRSXODWLRQ+DQ +DQ5RJHUV$OWKRXJKWRGLJ GHHSHUDQGKDYHPRUHLQVLJKWVRWKHUPRGHOVVXFKDVWKH7HFKQRORJ\$FFHSWDQFH0RGHO7$0 9DOXHGEDVHG$GRSWLRQ0RGHO9$0DQG6RFLDO,QIOXHQFH0RGHO6,ZHUHDOVRXVHG 7KH'LIIXVLRQRILQQRYDWLRQ0RGHO $VLJQLILFDQWIUDPHZRUNLQWKHLQQRYDWLRQWKHRU\LVUHSUHVHQWHGE\WKHGLIIXVLRQRI LQQRYDWLRQPRGHO5RJHUVZKLFKKHOSVWRXQGHUVWDQGKRZXVHUVDGRSWWKHQHZWHFKQRORJLHV RYHUWLPH7KHILYHDWWULEXWHVRILQQRYDWLRQVWKDWLQIOXHQFHWKHGHFLVLRQRIDGRSWLRQDUH5HODWLYH $GYDQWDJH&RPSDWLELOLW\&RPSOH[LW\7ULDODELOLW\DQG2EVHUYDELOLW\,QWKHSDUDJUDSKVEHORZWKH DWWULEXWHVDUHGLVFXVVHGZLWKLQWKHVSHFLILFFRQWH[WRI/06 7KHILYH$WWULEXWHVRIWKHLQQRYDWLRQPRGHO D 5HODWLYHDGYDQWDJH 5HODWLYHDGYDQWDJHLVWKHGHJUHHWRZKLFKDQLQQRYDWLRQLVSHUFHLYHGDVEHLQJEHWWHUWKDQWKH LGHDLWVXSHUVHGHV5RJHUV7RHYDOXDWHWKLVGRPDLQLWLVQHFHVVDU\WRXQGHUVWDQGLIPRELOH /060\&DWROLFDZDVSHUFHLYHGDGYDQWDJHRXVDQGLILWSURYLGHVDPRUHHIIHFWLYHOHDUQLQJ PDQDJHPHQWDVWKHVHFRQGLWLRQVPD\LQIOXHQFHVWXGHQWVRQWKHLUXVDJH E &RPSDWLELOLW\ &RPSDWLELOLW\LVKRZZHOOWKHLQQRYDWLRQPDWFKHVH[LVWLQJYDOXHVDQGPRGHOV7KHGHJUHHWR ZKLFKWKHIXQFWLRQDOLWLHVRIPRELOH/06DUHPDWFKHGZLWKWKHH[LVWLQJ3&DQG:HEEDVHG/06 DIIHFWVLWVDGRSWLRQ+DQDQG+DQ5RJHUV7RFKHFNWKLVGRPDLQLWLVLPSRUWDQWWR ILQGRXWWKHH[WHQWWRZKLFKWKHIXQFWLRQDOLWLHVRI0\&DWROLFDDUHPDWFKHGZLWKWKHH[LVWLQJ3&DQG :HEEDVHG/06DQGKRZGRHVLWDIIHFWWKHDGRSWLRQ F &RPSOH[LW\ &RPSOH[LW\LVWKHH[WHQWWRZKLFKWKHLQQRYDWLRQLVHDV\WRFRPSUHKHQGDQGXVH5RJHUV ,QWKHFXUUHQWVWXG\FRPSOH[LW\LPSOLHVWKDW0\&DWROLFDLVSHUFHLYHGDVEHLQJHDV\WR XQGHUVWDQGDQGXVH
10 G 7ULDODELOLW\ 7ULDODELOLW\LVWKHGHJUHHWRZKLFKDSRWHQWLDOXVHUFDQH[SHULPHQWZLWKWKHLQQRYDWLRQ ZLWKRXWKDYLQJWRFRPPLWWRXVHLW5RJHUV ,QWKHFXUUHQWVWXG\LWLPSOLHVWRXQGHUVWDQGXSWRZKDWSRLQWWKHWULDODELOLW\RI0\&DWROLFDLV HQKDQFLQJWKHSUREDELOLW\RIWKHVWXGHQWV¶DGRSWLRQ H 2EVHUYDELOLW\ )LQDOO\2EVHUYDELOLW\LVWKHH[WHQWWRZKLFKDSRWHQWLDODGRSWHUFDQVHHWKHXVHIXOQHVVRIWKH LQQRYDWLRQLQKLVKHUVLWXDWLRQ5RJHUV)RUH[DPSOHLIVWXGHQWVLQ&DWyOLFD/LVERQ6FKRRO RI%XVLQHVVDQG(FRQRPLFVFDQHDVLO\QRWLFHRWKHUVWXGHQWV¶XVHRI0\&DWROLFDDQGFRPSUHKHQGLWV DFDGHPLFFRQYHQLHQFHWKH\ZRXOGEHPRUHLQIOXHQFHGLQDGRSWLQJLW 2WKHUDWWULEXWH D 5HVLVWDQFH 5HVLVWDQFHLVUHODWHGWRWKHSV\FKRORJLFDOUHVLVWDQFHWRWKHDGRSWLRQRIQHZWHFKQRORJ\ EHFDXVHWKHLQQRYDWLRQIRUFHVDFKDQJHRIEHKDYLRU+DOO +RUG+DQDQG+DQ +HQFHLWZLOOEHPHDVXUHGKRZVWXGHQWVRI&DWROLFDDUHDIIHFWHGE\WKHFKDQJHLQWKHLUGDLO\ EHKDYLRUZKHQDGRSWLQJDQHZWHFKQRORJ\ 7HFKQRORJ\$FFHSWDQFH0RGHO7$0 7KHRULJLQDO7$0PRGHOIRFXVHVRQKRZWKHSHUFHSWLRQVRIXVHIXOQHVVDQGHDVHRIXVH DIIHFWWKHDGRSWLRQRIDQHZWHFKQRORJ\'DYLV'DYLVHWDODQGLWKDVDOVREHHQ ZLGHO\XVHGWRLQYHVWLJDWHLQQRYDWLRQDGRSWLRQLQHQJLQHHULQJLQWKHSDVWWKLUW\\HDUV'DYLV 'DYLVHWDO+DYLQJLQPLQGWKDWLQUHFHQW\HDUVPRELOHVDUHDUHDOLW\RISHRSOH¶VOLIHVWKH 7$0LVRIJUHDWLPSRUWDQFHHYHQLIIHZUHVHDUFKHUVKDYHVWXGLHGPRELOHWHFKQRORJLHVXQGHUWKLV PRGHO%DL\XQHWDO0LFKDHO (OOHQ.LP %RWKSHUFHLYHGHDVHRIXVHDQGSHUFHLYHGXVHIXOQHVVDUHHVVHQWLDOIRUXVHUV¶DGRSWLRQDQGDUH WKHNH\SHUFHSWLRQYDULDEOHVRI'DYLV¶RULJLQDO7$0IUDPHZRUN7KHVHFRPSRQHQWVDUH UHVSRQVLEOHIRUKRZWKHXVHUVSHUFHLYHWKHWHFKQRORJ\WREHLQWXLWLYHDQGLPSURYHWKHLUMRE SHUIRUPDQFH$GGLWLRQDOO\9HQNDWHVKHWDO/HHDOVREHOLHYHVWKDWWKHVHDUHWKHNH\ LQIOXHQWLDOIDFWRUVLQWKHDGRSWLRQRIPRELOHWHFKQRORJLHV 7KLVPRGHOVXJJHVWVKRZXVHUVDFFHSWDQGXVHWHFKQRORJ\DQGGHVFULEHVWZRDWWULEXWHVWKDW DIIHFWWKHLUFKRLFH
11
a) Ease of use
“The degree to which a person believes that using a particular system would be free from effort” (Davis 1989, p.320).
Ease of use refers to a belief of how a technology will influence the individual’s attitude towards adopting it. Studies show that there is a relationship between how an interface design looks and the ease of use of m-learning apps. To develop a purposeful user-friendly design for an
application is a big step towards captivating users. Moreover, if the application is too complex to work with, users would easily switch to other application – user’s attention with mobile applications is shorter than with desktop computers (Yan et al., 2012).
According to Abu-al-Aish et al. (2013) and Davis (1989), ease of use can positively affect mobile learning behavior.
Since this domain is similar to the Complexity (DOI), they both will be evaluated jointly in the research guide (Appendix 2). Thus, participants will define their perception of the ease of use of MyCatolica and which attribute will influence more their perception (design, page structure, etc.)
b) Perceived usefulness
"The degree to which a person believes that using a particular system would enhance his or her job performance" (Davis, 1989 p. 320 ).
Perceive usefulness relates to how much a person believes that using a specific system will aid in his, or her, performance. There are several studies that show a strong relation between the perceived usefulness of the user and its learning process. A solid perceived usefulness will propel productivity, performance and overall improve satisfaction – it has been consistently proved that perceived useful impact technology adoption and of overall satisfaction (Hassanein et al., 2010; Maha & Heba,2015).
To assess this domain, it was significant to examine the grade of benefits perceived by the alumna for their specific purpose by using MyCatolica.
12 9DOXHGEDVHG$GRSWLRQ0RGHO9$0 3HUFHLYHGYDOXHLVDIIHFWHGE\SHUFHLYHGEHQHILWVDQGSHUFHLYHGVDFULILFHV 7KLVPRGHOH[SODLQVXVHUV¶DGRSWLRQIURPDYDOXHSHUVSHFWLYHDWWULEXWH7KLVLVDQDWWULEXWHWKDW EHWWHUFRPSOHPHQWVWKH7$0PRGHO.LPHWDO,WKDVEHHQWDNHQLQFRQVLGHUDWLRQEHFDXVHLW DIIHFWVDGRSWLRQLQWHQWLRQDQGFRXOGSOD\DQLPSRUWDQWUROHLQWKHPRELOHFDPSXVDGRSWLRQ D 3HUFHLYHGYDOXH $GGLWLRQDOO\WRWKH7$0PRGHODWWULEXWHV³3HUFHLYHGYDOXHLVDQLQGLYLGXDO¶VRYHUDOO DVVHVVPHQWRIWKHXWLOLW\RIDSURGXFWVHUYLFHEDVHGRQWKHSHUFHSWLRQVRIZKDWLVUHFHLYHGDQGZKDW LVJLYHQ´=HLWKDPOS 7RHYDOXDWHKRZWKLVIDFWRUZLOOLQIOXHQFHWKHXVHRI/06WKHVWXG\QHHGVWRGHILQHZKDWYDOXHV 0\&DWROLFDLVEULQJLQJDQGLIWKH\DUHWKHVDPHRUVXSHULRUWKDQWKHRQHVWKDWWKHZHEVLWHFDPSXVLV SURYLGLQJ 6RFLDO,QIOXHQFH6, ,WLVDPRGHOWKDWVXJJHVWVWKDWVRFLDOLQIOXHQFHFKDUDFWHUL]HGE\HPRWLRQVRSLQLRQVDQG EHKDYLRUVFDQDIIHFWWKHSURGXFWDGRSWLRQ7KHPRGHOLVFRPSRVHGE\WKHVXEMHFWLYHQRUPZKLFK KDVEHHQGHILQHGDV³EHOLHIVWKDWFHUWDLQUHIHUHQWVWKLQNWKHSHUVRQVKRXOGRUVKRXOGQRWSHUIRUPWKH EHKDYLRULQTXHVWLRQ´)LVKEHLQ $M]HQSDQGWKHSHUFHLYHGVRFLDOSUHVVXUHWRSHUIRUP RUQRWWRSHUIRUPWKHEHKDYLRU$M]HQS 6XEMHFWLYHQRUPLVKRZWKHSHUFHSWLRQWKDWRWKHUVVWXGHQWVDUHXVLQJPRELOHGHYLFHVDIIHFW WKHSHUFHSWLRQRIDQLQGLYLGXDO±WKHOLNHOLKRRGRIDQLQGLYLGXDOWRDGRSWPRELOHGHYLFHVLVDIIHFWHG E\KRZPXFKKLVIHOORZVWXGHQWVXVHWKHP&RQQHUDQG$UPLWDJH$UPLWDJHDQG&RQQHU 0LFKDHO (OOHQ 7KLVGRPDLQLVVLPLODUWRWKH2EVHUYDELOLW\'2,DQGIRUWKLVUHDVRQWKH\ZLOOEHHYDOXDWHWRJHWKHU $FFRUGLQJO\LIVWXGHQWVRI&DWyOLFD/LVERQ6FKRRORI%XVLQHVVDQG(FRQRPLFVSHUFHLYHG 0\&DWROLFDZLGHVSUHDGDQGKRZLWLVLQIOXHQFLQJWKHLUDGRSWLRQ
13
0HWKRGRORJ\
,QRUGHUWRUHDFKYDOXDEOHUHVXOWVWKHUHVHDUFKZDVEDVHGRQIRUPHUVWXGLHVZKLFKKHOSHGWR XQGHUWDNHWKHIORZRIQHZWHFKQRORJ\DGRSWLRQDQGSULPDU\GDWDFROOHFWLRQ7KHSULPDU\GDWDZDV FROOHFWHGWKURXJKDTXDOLWDWLYHUHVHDUFKZKLFKZDVGHFLVLYHLQRUGHUWRFROOHFWQHZLQVLJKWVDQG JDLQGHSWKLQWKHDQDO\VLV 7RLGHQWLI\SHUWLQHQWDQGUHODWHGOLWHUDWXUHDQGVWXGLHVLQWKHPRELOHFDPSXVILHOGGLIIHUHQW GDWDEDVHVZHUHXVHG*RRJOH6FKRODUDQG(%6&2ZHUHXVHGWRVHDUFKIRUGRFXPHQWVDUWLFOHV MRXUQDOVUHSRUWVDQGSDSHUVXVLQJNH\ZRUGVDVLQQRYDWLRQKLJKHUHGXFDWLRQPRELOHFDPSXV PRELOHOHDUQLQJ *LYHQWKHUHVHDUFKREMHFWLYHVSUHVHQWHGZKLFKLQWHQGHGWRDGGUHVVWKHFDOOIRUPRUHLQ GHSWKLQWHUYLHZVZLWKXVHUVRIPRELOHFDPSXVDSSOLFDWLRQV+DQDQG+DQWKHFXUUHQW GLVVHUWDWLRQIRFXVHGRQLQGHSWKLQWHUYLHZVZLWKVWXGHQWVRI&DWyOLFD/LVERQ6FKRRORI%XVLQHVVDQG (FRQRPLFVRI/LVERQ7KHLQGHSWKLQWHUYLHZPHWKRGLVDTXDOLWDWLYHUHVHDUFKLQVWUXPHQWWKDWLV EDVHGRQLQGLYLGXDOLQWHUYLHZVWRH[SORUHDQGGLVFRYHUWKURXJKWKHLUSHUVSHFWLYHVSHFLILFLGHDVRU VFHQDULRV7KDQNVWRLWLWLVSRVVLEOHWRFRPHRXWZLWKGHWDLOHGLQIRUPDWLRQDERXWSHUFHSWLRQV IHHOLQJVDQGEHKDYLRUVSURYLGLQJDFRPSOHWHRYHUYLHZ 7KHDGYDQWDJHVRILQGHSWKLQWHUYLHZVDUHWKDWWKH\HQDEOHPRUHGHWDLOHGLQIRUPDWLRQWKDQ RWKHUGDWDFROOHFWLRQLHVXUYH\V7KH\DOVRSURYLGHDEHWWHUHQYLURQPHQWIRUWKHVWXG\DQGWKH SDUWLFLSDQWVDPRUHUHOD[HGDWPRVSKHUHWRFROOHFWGDWDDQGLWPD\PDNHSDUWLFLSDQWVIHHOPRUH FRPIRUWDEOHKDYLQJDOLYHFRQYHUVDWLRQZLWKWKHLQWHUYLHZHU 1HYHUWKHOHVVLQGHSWKLQWHUYLHZVSUHVHQWVRPHOLPLWDWLRQV5HVSRQVHVIURPWKHFRQWULEXWRUV FRXOGEHWHQGHQWLRXVDQGLQIOXHQFHGE\ELDVHVRIVHYHUDONLQGVLHE\WRSLFVWKDWSHUVRQDOO\DIIHFW WKHP)XUWKHUPRUHLWXVXDOO\SURGXFHVOHVVRUQRTXDQWLWDWLYHGDWDDQGDVDUHVXOWLWKDVOHVV VFLHQWLILFYDOXH$QLQGHSWKLQWHUYLHZLVFRQVLGHUHGPRUHWLPHLQWHQVLYHEHFDXVHRIWKHDPRXQWRI WLPHUHTXLUHGWRLQWHUYLHZWUDQVFULEHDQGDQDO\]HWKHUHVXOWV7KHLQWHUYLHZHUKDVWREHSURSHUO\ WUDLQHGDQGVXUHWRXVHWKHDSSURSULDWHWHFKQLTXHVLH(OXGLQJ\HVRUQRTXHVWLRQV&RQFOXVLYHO\ WKHUHVXOWVRIDQLQGHSWKLQWHUYLHZDUHXVXDOO\KDUGWRJHQHUDOL]HGXHWRVPDOOVDPSOHVL]HV &DURO\Q%R\FH 7KHSURFHVVIROORZHGWRFRQGXFWWKHLQGHSWKLQWHUYLHZVZDVDJHQHUDOSURFHVV³SODQ GHYHORSLQVWUXPHQWVFROOHFWGDWDDQDO\]HGDWDDQGGLVVHPLQDWHILQGLQJV´&DURO\Q%R\FH14 6DPSOH 'XULQJWKHSODQSKDVHDVVXJJHVWHGE\WKHOLWHUDWXUH&DURO\Q%R\FHWKHLQIRUPDWLRQ QHHGHGLHVLJQLILFDQWVRXUFHVRILQIRUPDWLRQDQGSRWHQWLDOSDUWLFLSDQWVZHUHLGHQWLILHGFRQWDFWHG DQGOLVWHG +HQFHVLQFHRXULQWHQWLVWRH[SORUHWKHIDFWRUVLQIOXHQFLQJWKHDGRSWLRQRIWKH&DWyOLFD/LVERQ 6FKRRORI%XVLQHVVDQG(FRQRPLFV¶VWXGHQWVLQWHUYLHZVZHUHFRQGXFWHGZLWKLWVVWXGHQWV7ZR VHJPHQWVZHUHLQYHVWLJDWHG8VHUVRIPRELOHFDPSXV0\&DWROLFDDQGQRQXVHUVRIPRELOH FDPSXV,QDGGUHVVLQJWKHVHVHJPHQWVWKHGLVVHUWDWLRQLQWHQGHGWREHFRQVLVWHQWZLWKWKHVWXG\RI ,QVRRN+DQDQG6HXQJ\HRQ+DQZKLFKVXJJHVWHGWRGLJGHHSHUH[SORULQJWKHVWXGHQWV¶ QHHG 7KHVWXGHQWVZHUHLQYLWHGWRYROXQWDULO\WDNHSDUWLQWKHUHVHDUFKZLWKRXWDQ\FUHGLWRU PRQHWDU\FRPSHQVDWLRQ7RUXQWKHDQDO\VLVILYHXVHUVVWXGHQWVWKDWFXUUHQWO\XVHLWDQGILYHQRQ XVHUVVWXGHQWVWKDWDUHQRWXVLQJLWZHUHLQWHUYLHZHG7KHUHVSRQGHQWVYDULHGLQDJHJHQGHUDQG QDWLRQDOLW\WKHQFDSDEOHWRSURYLGHDQGFRQWULEXWHZLWKPXOWLSOLFLW\LQSURVSHFWLYH 'DWDFROOHFWLRQ 7KHUHVHDUFKJXLGHLVDWWDFKHGLQWKHDSSHQGL[VHFWLRQ$SSHQGL[,WZDVVWUXFWXUHG IROORZLQJWKUHHSKDVHV ,QWKHILUVWSKDVHWKHSDUWLFLSDQWVZHUHDVNHGDERXWWKHLUSHUVRQDOLQIRUPDWLRQWRFUHDWHD UDSSRUWLQWKHVHFRQGSKDVHEDUULHUVZHUHDQDO\]HGDQGLQWKHWKLUGRQHWKHH[SORUDWLRQRIWKH VWXGHQWV¶QHHGZDVXQGHUWDNHQVRPHIXQFWLRQDOLWLHVZHUHSUHVHQWHGWRFKHFNKRZPXFKWKH\ZRXOG FRQIHUDQGFKHFNHGIRUWKHLUSRWHQWLDORQFRQYHUWLQJSHRSOHLQWRXVDJH 7RVWDUWFROOHFWLQJWKHGDWDLWZDVQHFHVVDU\WRUHFUXLWWKHVDPSOH$OOWKHSRVVLEOH SDUWLFLSDQWVRQWKH&DWROLFD¶V)DFHERRNSDJHZHUHFRQWDFWHGSULYDWHO\,WZDVH[SODLQHGWRWKHP WKDWWKHLUKHOSZDVUHTXLUHGWRDFKLHYHVRPHLPSRUWDQWLQIRUPDWLRQWKDWFRXOGKHOSWREULQJQHZ SHUNVWRWKHLUDFDGHPLFOLYHV)LQDOO\WKHVDPSOHZDVDQDO\]HGDQGGHWHUPLQHG &RQVHTXHQWO\WKH\ZHUHFRQWDFWHGRQFHDJDLQWRVFKHGXOHWKHLQWHUYLHZDQGWRLQIRUPWKHP WKDWWKHH[SHFWHGGXUDWLRQRIWKHLQWHUYLHZVZHUHUDQJHGIURPPLQXWHVWRPLQXWHVKDYLQJDQ DYHUDJHRIPLQV6RPHRIWKHLQWHUYLHZVZHUHSODQQHGLQWKH8QLYHUVLW\URRPVDQGVRPHZRXOG EHKHOGRQVN\SH2QWKHRQHKDQGWKLVDOORZHGWKHLQWHUYLHZHUWREHPRUHIOH[LEOHIDFLOLWDWLQJWKH
15 VFKHGXOLQJZLWKWKHUHVSRQGHQWVDQGRQWKHRWKHUKDQGLWPDGHWKHUHVSRQGHQWVPRUHLQWHUHVWHGDQG VDWLVILHG 0DWHULDOXVHGLQWKHUHVHDUFK &RQFHSWERDUGZLWKWKHGHVFULSWLRQRI0\&DWROLFD$SS 0\&DWROLFDLVDYDLODEOHIRUIUHHWRLWVVWXGHQWVWHDFKHUVDQGDFDGHPLFVWDII$VPDQ\0RELOH &DPSXVLWFRQQHFWVWKHDFDGHPLFFRPPXQLW\WRWKHXQLYHUVLW\VHUYLFHV,WDOORZVLWVXVHUVWRPDQDJH DQGFRQVXOWLWVFRQWHQWLQUHDOWLPH$FFHVVLQJWRGDWDRQUHJLVWUDWLRQVFKHGXOHVHYDOXDWLRQFDSDFLW\ RIWKHFDUSDUNVDQGRWKHULQIRUPDWLRQDERXWWKHFDPSXVDFWLYLWLHVVXFKDVVHPLQDUVDQGHYHQWV,WV SXUSRVHLVWRHQKDQFHWKHDFDGHPLFOLIHPDQDJHPHQWRIWLPHDQGFRPPXQLFDWLRQRIWKHVWXGHQWV SURIHVVRUVDQGWKHVWDII 5HVHDUFK*XLGH 7RGHYHORSWKHUHVHDUFKJXLGH$SSHQGL[WKDWOLVWVWKHGRPDLQVWREHH[SORUHGGXULQJWKH LQWHUYLHZLWZDVHVVHQWLDOWRUHVHDUFKWKHDVSHFWVWKDWIDFLOLWDWHDPRELOHFDPSXVDGRSWLRQ 7KHVHDVSHFWVZHUHORFDWHGDORQJWKHOLWHUDWXUHUHYLHZDQGDUHVWDWHGLQWKH7DEOHRI'LPHQVLRQV $SSHQGL[EHLQJXVHGDVPDLQWKHRUHWLFDOUHIHUHQFHIRUWKHGHYHORSPHQWRIWKHUHVHDUFKJXLGH
17
5HVXOWVDQG$QDO\VLV
(DFKLQWHUYLHZZDVUHFRUGHGDQGLPPHGLDWHO\WUDQVFULEHGDQGVXPPDUL]HG,QVXFKZD\LW ZDVHDVLHUWRDQDO\]HWKHRXWFRPHV7KHVXPPDUL]HGGDWDZHUHWKHQWUDQVFULEHGRQFHDJDLQDQG UHYLHZHG )ROORZLQJWKDWDFRPSXWHUWDEXODWLRQXVLQJ([FHOZDVXVHGWRDQDO\]HWKHFROOHFWHGGDWD &RQVLGHULQJWKHH[SORUDWRU\JRDORIWKLVUHVHDUFKUHVSRQVHVZHUHDQDO\]HGLQVHDUFKIRUGLIIHUHQW SDWWHUQVDQGWKHPHVDPRQJWKHSDUWLFLSDQWV7KDQNVWRLWLWZDVSRVVLEOHWRFOXVWHUWKHPLQD VLJQLILFDQWZD\ 6DPSOHSURILOH 3DUWLFLSDQWV¶EDFNJURXQGGHVFULSWLRQ 6WXGHQWVPDOHDQGIHPDOHIURP\HDUVROGWR\HDUVROGDWWHQGLQJD0DVWHUVRUDQ 8QGHUJUDGXDWHGHJUHHLQ&DWyOLFD/LVERQ6FKRRORI%XVLQHVVDQG(FRQRPLFV$OORIWKHPRZQD VPDUWSKRQH2QO\KDOIRIWKHPSRVVHVV0\&DWROLFD $OORIWKHWHQVWXGHQWVZKLFKWRRNSDUWLQWKHLQGHSWKLQWHUYLHZVZHUHLQSRVVHVVRID VPDUWSKRQHDQGDOORIWKHPZHUHXVLQJGLIIHUHQWNLQGRIDSSOLFDWLRQVIRUGLVWLQFWSXUSRVHVVFRSH LH6RFLDODSSOLFDWLRQVJDPHVQHZVPRELOHFDPSXVHWF+DOIRIWKHPZHUH,QWHUQDWLRQDOVWXGHQWV DQGKDOIRIWKHPZHUH3RUWXJXHVHZKHUHZHUHQRWDGRSWLQJ0\&DWROLFDDQGWKHZHUH FXUUHQWXVHUV%HVLGHVRIWKHPDOUHDG\WULHGWKH&DWROLFDPRELOHFDPSXVDQGWKHQHYHU WULHGLWEHIRUH 7KHUHVHDUFKJXLGHZDVGLYLGHGLQWRWKUHHSDUWV7KHILUVWSDUWRIWKHLQWHUYLHZWRFUHDWHD UDSSRUWDQGPDNHWKHSDUWLFLSDQWIHHOLQJFRPIRUWDEOH7KHVHFRQGZDVGHGLFDWHGWRWKHHYDOXDWLRQRI WKHGRPDLQVWKDWFRXOGLQIOXHQFHWKHDGRSWLRQRIWKHPRELOHFDPSXVVXJJHVWHGE\WKHSDVW UHVHDUFKHV,QWKLVZD\LWZDVSRVVLEOHWRFKHFNDQGYDOLGDWHWKHUHVXOWVRISDVWVWXGLHVDOVRLQ 3RUWXJXHVHFRQWH[WDQGILOOWKHJDSVDQGOLPLWDWLRQVKLJKOLJKWHGLQWKH&\EHU8QLYHUVLW\VWXG\ &RQVHTXHQWO\WKHVHFRQGSDUWZDVGHGLFDWHGWRWKHH[SORUDWRU\SKDVH6WXGHQWVZHUHDVNHGZKLFK ZHUHWKHSRVVLEOHVHUYLFHVWRLQWHJUDWHWRWKHDFWXDOPRELOHFDPSXVDQGVL[QHZVHUYLFHVZHUH VKRZHG7KUHHVHUYLFHVWKRXJKWWRHQKDQFHWKHVWXGHQWOLIH67$<6(9(176)/($0$5.(7 DQGWKUHHZLWKHGXFDWLRQDODQGRUJDQL]DWLRQDOEHQHILWVSXUSRVHV&+$7&/28'127(18 7DEOH3DUWLFLSDQWV 5HVXOWV %HIRUHDQDO\]LQJWKHUHVXOWVLQGHWDLOLWLVLPSRUWDQWWRDFNQRZOHGJHWKDWSDUWLFLSDQWVRYHUDOO H[SUHVVHGWKHLULPSUHVVLRQWKDWWKH0\&DWROLFDLVQRWZRUNLQJSURSHUO\ZLWKPDQ\IXQFWLRQDOLWLHV QRW\HWHQDEOHGRUQRWXSGDWHGLH3DUNLQJFDQWHHQPHQXHWF 0RVWRIWKHUHOHYDQWWUDQVFULSWVWKDWVXSSRUWDQGH[SODLQWKHUHVXOWVDUHDYDLODEOHLQWKH DSSHQGL[HVVHFWLRQ$SSHQGL[HVIURPWR 0RVWRIWKHUHOHYDQWWUDQVFULSWVWKDWVXSSRUWDQGH[SODLQWKHUHVXOWVDUHDYDLODEOHLQWKH 3DUW2QH&XUUHQWLPDJHRI0RRGOHDQG0\&DWROLFD¶VDZDUHQHVV 7REHWWHUXQGHUVWDQGWKHQHHGVRIWKHSDUWLFLSDQWVLWZDVUHOHYDQWWRNQRZWKHLUSHUFHSWLRQ DERXW0RRGOHWKHPRVWLQIOXHQWDQGXVHGSODWIRUPDQGWKHDZDUHQHVVDERXW0\&DWROLFD 3UDFWLFDOO\WKHUHLVDFRQVWDQWDQGVWURQJXVHRI0RRGOHE\WKHVWXGHQWVEHFDXVHLWLVDOPRVWD PDQGDWRU\SDUWRIWKHLUFRXUVHV7KH\FRPPXQLFDWHZLWKWKHSURIHVVRUVDQGIUHTXHQWO\FKHFN LQIRUPDWLRQDVJUDGHVQHZVV\OODEXVRIWKHFRXUVHVDQGPDWHULDOVDVVOLGHVH[HUFLVHVFDVHVDQG TXL]]HV$SSHQGL[+HQFH0RRGOHKDVEHHQSHUFHLYHGDVDQHVVHQWLDOWRROIRUWKHDFDGHPLFOLIH
1 3DUWLFLSDQW *HQGHU 1DWLRQDOLW\ $JH 3URJUDP
1RQXVHU )HPDOH 9LHW1DP 0DVWHULQ0DUNHWLQJ
1RQXVHU 0DOH %UD]LO 0DVWHU,QQRYDWLRQDQG7HFKQRORJ\
1RQXVHU 0DOH *HUPDQ\ 0DVWHULQ0DUNHWLQJ
1RQXVHU 0DOH 3RUWXJDO 0DVWHULQ,QQRYDWLRQDQGHQWUHSUHQHXUVKLS
1RQXVHU )HPDOH 3RUWXJDO 8QGHUJUDGXDWHLQ%XVLQHVV$GPLQLVWUDWLRQ
8VHU )HPDOH 3RUWXJDO 0DVWHULQ0DUNHWLQJ
8VHU )HPDOH 3RUWXJDO,WDO\ 0DVWHULQ6WUDWHJ\
8VHU )HPDOH 5RPDQLD 0DVWHULQ%XVLQHVV
8VHU 0DOH 3RUWXJDO 0DVWHULQ)LQDQFH
19 DQGPRUHUHOLDEOH7KHQWKHDZDUHQHVVDERXW0\&DWROLFDZDVDOPRVWSUHVHQWLQDOOWKHSDUWLFLSDQWV 2QFHXQGHUVWRRGWKHSDUWLFLSDQWEHKDYLRUDZDUHQHVVSHUFHSWLRQDERXW0RRGOHDQG 0\&DWROLFDLWVWDUWHGWKHHYDOXDWLRQRIWKHGRPDLQVVXJJHVWHGRQWKHOLWHUDWXUH 3DUW7ZR(YDOXDWLQJWKHGRPDLQVWKDWFRXOGDIIHFWWKHDGRSWLRQRI0\&DWROLFD &RPSDWLELOLW\ $VGHILQHGE\WKHOLWHUDWXUHFRPSDWLELOLW\LVDQLPSRUWDQWDVSHFWLQWKHDGRSWLRQRIQHZ WHFKQRORJLHVEHFDXVHXVHUVWHQGWROHYHUDJHWKHLUEHKDYLRUVRQWKHNQRZOHGJHWKH\KDYHUHJDUGLQJ WKHSDVWFRPSDUDEOHWHFKQRORJ\WKDWWKH\NQRZ+DQDQG+DQ,QWKLVFDVHLWKDVEHHQ DQDO\]HGWKHH[WHQWWRZKLFKWKHIXQFWLRQDOLWLHVRI0\&DWROLFDDUHFRPSDUDEOHZLWKWKHXQLYHUVLW\V ZHEVLWH0RRGOH 5HJDUGLQJWKDWWKHPDMRULW\RISDUWLFLSDQWVDFNQRZOHGJHGWKHH[LVWHQFHRIYDULRXV IXQFWLRQDOLWLHVUHODWHGWRWKHFRXUVHVLQIRUPDWLRQJUDGHVFODVVURRPVVFKHGXOHVQHZVDQG SURIHVVRUFRPPXQLFDWLRQVWKDWZHUHVLPLODUWR0RRGOH 1HYHUWKHOHVVWKHPDLQGLIIHUHQFHKLJKOLJKWHGE\WKHPDMRULW\LVWKHLPSRVVLELOLW\WRDFFHVV WKHFRXUVHPDWHULDOVVXFKDVVOLGHVV\OODEXVDQGH[HUFLVHVZKLFKDUHSHUFHLYHGDVRQHRIWKHPRVW LQIOXHQWIDFWRULQVWXGHQWVDFDGHPLFOLIH7KDWEHLQJWKHFDVHDVLQ0\&DWROLFDWKH\FDQQRW GRZQORDGPDWHULDOVQHLWKHUXSORDGWKHPRUUHDGWKHPWKH\UHIHUWRLWDVDOLPLWHGYHUVLRQRI 0RRGOH2WKHUSDUWLFLSDQWVUHIHUWR0\&DWROLFDDVDJHQHUDOLVWSODWIRUPDVLWFRPELQHVLQIRUPDWLRQ RIDOOFDPSXVSODWIRUPVSURYLGLQJWKHVDPHLQIRUPDWLRQWKDWFDQEHIRXQGRQ(6&$DQG &DWROLFD¶V:HEVLWHWUHDVXU\FDOHQGDUVFKHGXOHVHYHQWKRXJKVRPHVWLOOSUHIHUWRWKHZHEVLWH SODWIRUPVEHFDXVHFRQVLGHUHGPRUHUHOLDEOH $GGLWLRQDOO\LWKDVEHHQKLJKOLJKWHGWKDWXVHUVGRQRWQHHGWRORJLQHYHU\WLPHWRXVH 0\&DWROLFDDVLWLVQHFHVVDU\IRUWKHZHEVLWHVEXWWKH\FDQQRWHQUROORUGLUHFWO\FRPPXQLFDWH ZLWKWKHSURIHVVRUV 7KHSDUWLFLSDQWVLQJHQHUDODJUHHWKDW0\&DWROLFDVKRXOGEHPRUHVLPLODUWRWKHRWKHU SODWIRUPVEHFDXVHGHVSLWHRIIHULQJVRPHXVHIXOIXQFWLRQDOLWLHVUHJDUGLQJFDPSXVLQIRUPDWLRQLWLV QRWKHOSIXORQVXSSRUWLQJVWXGHQWVDFDGHPLFOLYHV,QIDFWSDUWLFLSDQWVDJUHHWKDWLI0\&DWROLFD ZHUHPRUHVLPLODUWR0RRGOHWKH\ZRXOGLQFUHDVHLWVDGRSWLRQDQGXVDJH
20 )XUWKHUPRUHUHJDUGLQJWKHGLIIHUHQFHVEHWZHHQWKH0\&DWROLFDDQG0RRGOHD3RUWXJXHVH VWXGHQWQRWLFHGDORQJWKHUHVHDUFKWKDWKHFRXOGDFFHVVWKH³UHVWDXUDQWV´IXQFWLRQDOLW\'HVSLWH DSSUHFLDWLQJLWKHZDVQHYHUWKHOHVVVXUSULVHGWKDWWKHDSSOLFDWLRQZDVDYDLODEOHRQO\LQ3RUWXJXHVH JLYHQXQLYHUVLW\VLQWHUQDWLRQDOYDOXHVDQGFRQVLGHUDEOHQXPEHURIIRUHLJQVWXGHQWV ,QVXPWKHPDLQILQGLQJUHJDUGLQJFRPSDWLELOLW\LVWKHQHHGIRU0\&DWROLFDWRJHWFORVHUWR WKHIXQFWLRQDOLWLHVRI0RRGOH)RUWKDWDQXSJUDGHRI0\&DWROLFDWKURXJKWKHDGGLWLRQRI LQWHUDFWLYHIXQFWLRQDOLWLHVXSORDGGRZQORDGDFFHVVWRPDWHULDOVZRXOGEHGHVLUDEOH(YHQLIIRU XVHUVWKHLQIRUPDWLRQSURYLGHGDQGWKHOHYHORIFRPSDWLELOLW\ZHUHDOUHDG\HQRXJKWRDGRSWLW GRZQORDGLWLWLVFOHDUO\QRWHQRXJKWRPRWLYDWHKLJKHUOHYHORIXVDJH$SSHQGL[ 5HODWLYHDGYDQWDJH 5HODWLYHDGYDQWDJHLVGHILQHGLQWKHOLWHUDWXUHDVWKHH[WHQWWRZKLFKWKHQHZWHFKQRORJ\LV SHUFHLYHGVXSHULRUWKDQWKHSUHYLRXVRQH5RJHUV,QWKHVSHFLILFFRQWH[WRI0\&DWROLFDLW ZRXOGLPSO\WKDWWKHDSSOLFDWLRQZRXOGEHSHUFHLYHGDVPRUHDGYDQWDJHRXVWKDQWKHZHEVLWHV VHUYLFHV 3DUWLFLSDQWVSUHGRPLQDQWO\DFNQRZOHGJH0\&DWROLFDVSRUWDELOLW\DQGDFFHVVLELOLW\WRDOO LQIRUPDWLRQLQRQHWRRODVLPSRUWDQWDGYDQWDJHVUHODWLYHWR0RRGOH6RPHUHIHUVSHFLILFDOO\WRWKH KHOSWKDWWKHDSSOLFDWLRQSURYLGHVRQZHOFRPLQJQHZVWXGHQWV2WKHUVUHIHUWRWKHSDUNLQJIDFLOLW\ ZKLFKLVXVHIXOWRNQRZLIWKHUHDUHIUHHVORWV2QWKHRWKHUKDQGGHVSLWHWKHVHDGYDQWDJHVWKH SDUWLFLSDQWVRQFHDJDLQFULWLFL]HWKHDSSOLFDWLRQIRUQRWSURYLGLQJDQ\DFFHVVWRWKHDFDGHPLF PDWHULDOV$QHJDWLYHFULWLFZDVDOVRUHFDOOHGE\DQ,QWHUQDWLRQDOQRQXVHUZKLFKHYLGHQFHGWKH 3RUWXJXHVHODQJXDJHDQGWKHPLVVLQJFKDWDVLPSRUWDQWGLVDGYDQWDJHV 7KHUHODWLYHDGYDQWDJHVUHODWHGWRSHUFHLYHGDFFHVVLELOLW\DQGSRUWDELOLW\RILQIRUPDWLRQ VHHPVWRSRVLWLYHO\LQIOXHQFHWKHDGRSWLRQRI0\&DWROLFDWKURXJKLWVLQLWLDOGRZQORDG+RZHYHU ZKLOHXVLQJWKHDSSOLFDWLRQXVHUVSHUFHLYHWKDW0RRGOHLVPRUHXVHIXOFRQFOXGLQJWKDWWKH DGYDQWDJHVLQLWLDOO\SHUFHLYHGZHUHQRWHQRXJKWRPRWLYDWHXVDJH$SSHQGL[ ZKLOHXVLQJWKHDSSOLFDWLRQXVHUVSHUFHLYHWKDW0RRGOHLVPRUHXVHIXOFRQFOXGLQJWKDWWKH 3HUFHLYHGYDOXH %HLQJGHILQHGLQWKHOLWHUDWXUHDVWKH³LQGLYLGXDO¶VRYHUDOODVVHVVPHQWRIWKHXWLOLW\RID SURGXFWVHUYLFHEDVHGRQWKHSHUFHSWLRQVRIZKDWLVUHFHLYHGDQGZKDWLVJLYHQ´=HLWKDPO SLWKDVEHHQHYDOXDWHGZKLFKYDOXHV0\&DWROLFDLVRIIHULQJDQGLIWKH\DUHGLIIHUHQWIURPWKH RQHVDOUHDG\RIIHUHGE\0RRGOH
21 :KHQTXHVWLRQHGDERXWWKH3HUFHLYHG9DOXHRIWKHDSSOLFDWLRQWKHPDMRULW\RISDUWLFLSDQWV DQVZHUHGWKDWSRUWDELOLW\DQGDFFHVVLELOLW\WRLQIRUPDWLRQDUHWKHPRVWLPSRUWDQWYDOXHV7KH DSSOLFDWLRQFRXOGJLYH\RXWKHLQIRUPDWLRQRIWKH8QLYHUVLW\ULJKWLQ\RXUKDQG&HUWDLQO\WKHVHWZR YDOXHVRIIHUHGIRUP0\&DWROLFDDUHGLIIHUHQWYDOXHVZKLFKZHEEDVHGSODWIRUPVFRXOGQRWSURYLGH DQGDUHDSRVLWLYHLQIOXHQFHIRUXVHUV¶DGRSWLRQ$VZHOOLQQRYDWLRQKDVEHHQPHQWLRQHGDVDQHZ YDOXHWKDWLQFUHDVHWKHSHUFHLYHGYDOXHRIWKHPRELOHFDPSXV7KLVYDOXHHPSKDVL]HVWKH HQKDQFHPHQWRIWKH8QLYHUVLW\LPDJHDQGWKH8QLYHUVLW\VXSSRUWWRWKHVWXGHQWV¶DFDGHPLFOLIH +HQFHXVHUVDUHLQIOXHQFHGE\WKHLUSRVLWLYHSHUFHLYHGYDOXH+RZHYHUHYHQLIWKHPDMRULW\ RIQRQXVHUVDUHDZDUHRIWKHSRWHQWLDOYDOXHVRIWKHDSSOLFDWLRQWKHLUSHUFHSWLRQRI0\&DWROLFD¶ YDOXHLVQHJDWLYHEHFDXVHLWLVQRWVXSSRUWLYHIRUWKHLUDFDGHPLFSHUIRUPDQFH$SSHQGL[ 7ULDODELOLW\ 7ULDODELOLW\LVGHILQHGDVWKHGHJUHHWRZKLFKDSRWHQWLDOXVHUFDQH[SHULPHQWZLWKWKH LQQRYDWLRQZLWKRXWKDYLQJWRFRPPLWWRXVHLW5RJHUV,QWKHVSHFLILFFRQWH[WRIUHVHDUFKLW ZDVUHOHYDQWWRXQGHUVWDQGXQWLOZKLFKOHYHOWKH7ULDODELOLW\RI0\&DWROLFDLVLQFUHDVLQJWKH DGRSWLRQ¶VSRVVLELOLW\ 7KHIDFWWKDW0\&DWROLFDZDVSURYLGHGIRUIUHHPDGHWKHWULDOHDVLO\DFFHVVLEOHIRUDOO SDUWLFLSDQWVWKDWZHUHDZDUHRILWVH[LVWHQFH+HQFHIRXUQRQXVHUVRXWRIILYHWULHGTXLFNO\ DQGTXLWWHGDVLWGLGQRWZRUNDVWKH\H[SHFWHGDQGMXVWRQHKDGQHYHULQVWDOOHGWKHDSSOLFDWLRQ7KH PDMRULW\RIWKHUHVSRQGHQWVVXVWDLQHGWKDWWKH\ZRXOGQHYHUFRQVLGHUSD\LQJIRUWKHDSSOLFDWLRQDQG VXVWDLQWKHLGHDWKDWLWVKRXOGEHDIUHHVHUYLFHRIIHUHGE\WKH8QLYHUVLW\1HYHUWKHOHVVWZRRIWKHP ZRXOGVWLOOFRQVLGHUSD\LQJIRUWKHVHUYLFHLIWKH\ZRXOGSHUFHLYHFRQVLVWHQWOHDUQLQJXWLOLW\ DVVRFLDWHGWRLW$SSHQGL[ 7KHQDVZHFDQVHHIURPWKHUHVXOWVWKHIDFWWKDWWKHSURGXFWLVIUHHFRXOGLQIOXHQFHMXVWWKH LQLWLDODGRSWLRQDIWHUZDUGLWLVQRWHQRXJKWRUHWDLQ7KLVPHDQVWKDWVWXGHQWVGHVLUHWKHDSSOLFDWLRQ DQGWKHWULDODELOLW\KHOSVWRLQFUHDVHWKHDSSHDORILW(YHQWKRXJKWKHELJREVWDFOHLVWRFRQYHUWWKH LQLWLDOXVHLQWRILQDODGRSWLRQDQGLQRUGHUWRUHDFKWKDW0\&DWROLFDQHHGVWREHPRUHHIILFLHQW &RPSOH[LW\(DVHRIXVH &RPSOH[LW\RU(DVHRIXVHDUHGHILQHGDVDGHJUHHWRZKLFKDXVHUSHUFHLYHDVSHFLILFV\VWHP IUHHIURPHIIRUW5RJHUV'DYLV,QWKHSDUWLFXODUVFHQDULRRIWKHFXUUHQWUHVHDUFK SDUWLFLSDQWVZHUHDVNHGDERXWWKHLUSHUFHSWLRQRI0\&DWROLFD¶VHDVHRIXVHDQGZKLFKZHUHWKH DWWULEXWHVWKDWLQIOXHQFHGWKHLUEHOLHIV
22 $OOUHVSRQGHQWVDJUHHWKDWWKHHDVHRIXVHLVDYHU\LPSRUWDQWIDFWRUWKDWFRXOGLQIOXHQFH WKHLUDGRSWLRQ:KHQDVNHGLI0\&DWROLFDLVHDV\WRXVHWKHPDMRULW\DQVZHUHGSRVLWLYHO\HYHQ WKRXJKLWKDVEHHQKLJKOLJKWHGE\VRPHLQWHUQDWLRQDOVWXGHQWVWKDWWKHODQJXDJHEDUULHUFRXOG FRPSURPLVHGWKHHDVHRIXVH7KHIHDWXUHVWKDWPRVWVWURQJO\DIIHFWWKHHDVHRIXVHDUHWKHDWWULEXWHV WKDWDIIHFWWKHQDYLJDELOLW\WKHSDJHVWUXFWXUHPDLQPHQXGHVLJQYLVXDODQGVLPSOHDQGWKH UHDGDELOLW\ :KHQFRPSDULQJWKHLPSRUWDQFHRIWKHHDVHRIXVHZLWKFRQWHQWVDQGIXQFWLRQDOLWLHVWKH PDMRULW\HYLGHQFHGWKDWWKHHDVHRIXVHKDVWREHDVWDQGDUGSULRULW\3DUWLFLSDQWVVXVWDLQHGWKDW ZLWKRXWWKHHDVHRIXVHWKHFRQWHQWVDQGIXQFWLRQDOLWLHVDUHQRWVRUHOHYDQWDQGWKH\ZRXOGUDWKHU DFFHVV0RRGOHLQVWHDG2YHUDOOXVHUVDQGQRQXVHUVGHILQH0\&DWROLFDDVEHLQJXVHUIULHQGO\ )RUXVHUVWKHSHUFHSWLRQRIWKHHDVHRIXVHLVH[WUHPHO\LPSRUWDQWHYHQLIVXSSRUWHGE\WKHSRRU IXQFWLRQDOLWLHVSURYLGHGLWLVHQRXJKWRDGRSWWKHDSSOLFDWLRQWKH\VHHYDOXHLQDVSHFWVWKDWQRQ XVHUVGRQW2QWKHFRQWUDU\IRUQRQXVHUVIXQFWLRQDOLWLHVDUHPRUHLPSRUWDQWDQGHYHQZKHQWKH HDVHRIXVHRIWKHPRELOHFDPSXVLVSHUFHLYHGLWLVQRWHQRXJKWRDIIHFWSRVLWLYHO\WKHLUDGRSWLRQ $SSHQGL[ 5HVLVWDQFH ,WLV³WKHHIIRUWWKDWDVWXGHQWKDYHWRSHUIRUPZKHQFKDQJLQJKLVKHUKDELWVLQIDYRURIWKH QHZWHFKQRORJ\´+DOO +RUG+DQDQG+DQ,ILWLVWRRKLJKIRUWKHYDOXHSURSRVHGLW ZLOOQHJDWLYHO\LQIOXHQFHWKHDGRSWLRQ :KLOHHYDOXDWLQJWKLVDVSHFWLWKDVEHHQHYLGHQFHGWKDWWKHHIIRUWRIFKDQJLQJKDELWVRIWKHLU GDLO\URXWLQHFRXOGEHVWURQJDOWKRXJKWKHPDMRULW\RIQRQXVHUVGRQRWEHOLHYHWKDWWKHPDLQFDXVH RIWKHLUQRQDGRSWLRQLVDVVRFLDWHGZLWKUHVLVWDQFH7KH\ZHUHYHU\FDWHJRULFDOVXVWDLQLQJWKDW FRPPRQO\\RXQJSHRSOHHDVLO\DGDSWWRFKDQJHVDQGLIWKHWRROEULQJVFRQYHQLHQFHDQGFRPIRUW YDOXHVIRUWKHPROGKDELWVZLOOQRWEHDVWURQJEDUULHUWRRYHUFRPH 7KHUHE\UHVLVWDQFHFRXOGQHJDWLYHO\DIIHFWWKHXVDJH+RZHYHULWKDVEHHQVKRZQWKDWLIWKH VWXGHQWVUHFRJQL]HWKHEHQHILWVYDOXHVRIWKHPRELOHFDPSXVKDELWVVKRXOGQRWEHDSUREOHP 2QHQRQXVHUVXJJHVWHGWKHQHHGIRULQFUHDVLQJWKHPDUNHWLQJHIIRUWVWRZDUGVPRWLYDWLQJ VWXGHQWVWRXVHWKHDSSOLFDWLRQ,QKLVRSLQLRQWKLVFRXOGEHDJRRGLQLWLDWLYHIRUPDQDJLQJ UHVLVWDQFH$SSHQGL[
23 2EVHUYDELOLW\6RFLDO,QIOXHQFH ,WLVWKHWKHSHUFHLYHGVRFLDOSUHVVXUHWRSHUIRUPRUQRWWRSHUIRUPWKHEHKDYLRU$M]HQ S7KHUHIRUHKRZLVWKHSHUFHSWLRQRI0\&DWROLFDGLIIXVLRQLQIOXHQFHVWKHVWXGHQWV¶ DGRSWLRQ )LUVWLWZDVLPSRUWDQWWRXQGHUVWDQGZKDWZDVWKHSHUFHSWLRQRIWKHVWXGHQWVUHJDUGLQJWKH GLIIXVLRQRI0\&DWROLFDDQGWKHRYHUDOOSHUFHSWLRQDERXWLWLVYHU\SRRU1LQHRIWKHPWKLQNWKDWWKH DSSOLFDWLRQLVQRWZLGHVSUHDGDQGMXVWRQHRIWKHPWKLQNVWKDWLWLVPRUHRUOHVVVSUHDG7KLVILUVW TXHVWLRQZDVUHOHYDQWWRFKHFNLIWKHVROHIDFWRISHUFHLYLQJWKHDSSOLFDWLRQZLGHVSUHDGDOORYHUWKH VWXGHQWVZRXOGLQIOXHQFHWKHLUDGRSWLRQ:KHQWKHQRQXVHUVZHUHDVNHG³,IWKH0\&DWROLFD DSSOLFDWLRQZDVZLGHVSUHDGDOORYHUWKHVWXGHQWVKRZLWZRXOGDIIHFW\RXUZLOOLQJQHVVWRXVH"³-XVW KDOIRIWKHPVDLGWKDWWKH\ZRXOGEHSRVLWLYHO\LQIOXHQFHGWKHUHVWPDQLIHVWHGWREHPRUHVHOI FHQWHUHGFDULQJPRUHDERXWWKHLURZQIHHOLQJ 6XEVHTXHQWO\DOORIWKHPKDYHEHLQJVXEPLWWHGWRDGLIIHUHQWTXHVWLRQLQRUGHUWRHYDOXDWHLI 6,LVVXSSRUWHGE\DUHFRJQLWLRQRIUHDOEHQHILWVPDQLIHVWHGE\XVHUV³$QGLI\RXZHUHQRWLFLQJ WKDWWKHDSSOLFDWLRQZDVEULQJLQJHGXFDWLRQDORUJDQL]DWLRQDODQGPDQDJHULDOEHQHILWVWRWKHPZKDW ZRXOGLWFKDQJH"³,QWKLVFDVHPRVWSDUWLFLSDQWVFRQVLGHUHGWKH6RFLDOLQIOXHQFHDVDSRVLWLYH IDFWRUIRUWKHLUDGRSWLRQDVLWOLQNHGWRUHDOEHQHILWV1RQXVHUVZLOOEHPRUHOLNHO\WRWU\LWDQG XVHUVPRUHUHWDLQHG +HQFHWKHILQGLQJVUHYHDOWKDWLIWKHDSSOLFDWLRQZDVZLGHVSUHDGHYHQWKHQRQXVHUVZRXOG FRQVLGHUDGRSWLQJLW$SSHQGL[ 3HUFHLYHGXVHIXOQHVV 'HILQHGIURPWKHOLWHUDWXUHDV7KHGHJUHHWRZKLFKDSHUVRQEHOLHYHVWKDWXVLQJDSDUWLFXODU V\VWHPZRXOGHQKDQFHKLVRUKHUMRESHUIRUPDQFH'DYLVS+HQFH,WZLOOEHPHDVXUHG WKHDPRXQWRIEHQHILWVUHFRJQL]HGE\WKHVWXGHQWVLIXVLQJ0\&DWROLFDDQGKRZWKLVZLOOLQIOXHQFH WKHLUDGRSWLRQ )RUHYDOXDWLQJWKDWSDUWLFLSDQWVKDGWRGHVFULEHZKDWZDVWKHSXUSRVHRIWKHDSSOLFDWLRQ 7KHELJJHVWSHUFHQWDJHFODLPWKDWWKHSXUSRVHRIWKHDSSOLFDWLRQLVWRKHOSWKHVWXGHQWVDQGHQKDQFH WKHVWXGHQWOLIHWKURXJKRXWDQHZWHFKQRORJ\WKDWSURYLGHVEHWWHUFRPPXQLFDWLRQXVHIXO IXQFWLRQDOLWLHVHDV\DFFHVVWRWKHLQIRUPDWLRQHGXFDWLRQDODQGOHDUQLQJYDOXHV
24 $IWHUWKLVWKHSDUWLFLSDQWVUHFHLYHGDFDUGZLWKDVWDWHPHQWRQLWDQGZHUHDVNHGWRJLYHWKHLU SHUVRQDOLPSUHVVLRQVDQGIHHOLQJVDERXWLW7KHFDUGZDVJLYHQWRWKHPZLWKWKHSXUSRVHRI JHQHUDWLQJDGHHSHUUHIOHFWLRQ ´7KLVDSSOLFDWLRQDOORZV\RXWRVKDUHLQUHDOWLPHWKHGLIIHUHQWH[SHULHQFHVWKDWWKHFDPSXV SURYLGHVNHHSLQJVWXGHQWVDOZD\VLQIRUPHGDERXWWKHLQLWLDWLYHVRIWKH8QLYHUVLW\ZKLFKZLOO SURYLGHJUHDWHUSDUWLFLSDWLRQDQGVWXGHQWLQWHUDFWLRQLQDFDGHPLFOLIH´ 7KHUHDFWLRQWRWKLVGHFODUDWLRQZDVQHJDWLYHIURPDOORIWKHVWXGHQWVLQWHUYLHZHGEHFDXVHLW VRXQGHGXQWUXHWRWKHP7KLVUHDFWLRQKLJKOLJKWHGKRZGLIIHUHQWLVWKHSHUFHSWLRQRIWKHVXSSOLHU DQGWKHXVHUV$QRQXVHUDOVRGHFODUHGWKDWLIWKDWSURPLVHZDVUHDOLWZRXOGVWURQJO\LQIOXHQFHKLV DGRSWLRQ $FFRUGLQJO\ZHFDQVD\WKDWQRQXVHUV¶SHUFHSWLRQRIWKHXVHIXOQHVVLVFHUWDLQO\QHJDWLYH DQGLWLVUHIOHFWHGLQWKHLUQRQDGRSWLRQ$VLWKDVEHHQKLJKOLJKWHGSUHYLRXVO\VWXGHQWVSHUFHLYHG WKHDSSOLFDWLRQDVDQRWZRUNLQJWRROWKHUHIRUHXVHOHVV%XWLIWKHSHUFHSWLRQZDVSRVLWLYHLWZRXOG DFWXDOO\LQIOXHQFHWKHLUDGRSWLRQ:KLOHIRUXVHUVZKRPKDYHDGLIIHUHQWSHUFHSWLRQIURPWKH TXRWHSHUFHLYHWKHWRRODVXVHIXOHQRXJKWREHDGRSWHG$VZHKDYHQRWLFHGXVHUVDUHDOUHDG\ VDWLVILHGWRXVHWKHWRRODVDQLQIRUPDWLRQDOWRRO ,QFRQFOXVLRQWKHUHLVQRGRXEWWKDWWKHSHUFHLYHGXVHIXOQHVVLQIOXHQFHWKHDGRSWLRQRIWKH PRELOHFDPSXV$SSHQGL[ PRELOHFDPSXV 3DUWWKUHH([SORUDWRU\SKDVH $IWHUHYDOXDWLQJWKHGRPDLQVWKDWFRXOGLQIOXHQFHWKHDGRSWLRQRIDQHZWHFKQRORJ\DV VXJJHVWHGDQGVXSSRUWHGE\WKHOLWHUDWXUHLWZDVYHU\LQWHUHVWLQJWRH[SORUHKRZVWXGHQWVUHDFWWR DOWHUQDWLYHVHUYLFHV$QGHYDOXDWHWKHLUSHUFHSWLRQDERXWVL[QHZVHUYLFHVWKRXJKWWRRYHUFRPHWKH DGRSWLRQEDUULHUV 7RLQWURGXFHWKHH[SORUDWRU\SDUWRIWKHLQWHUYLHZLWKDVEHHQDVNHGWRWKHSDUWLFLSDQWVWR GHVFULEHWKHGHVLUHGIHDWXUHVWKDWWKH\ZRXOGOLNHWRVHHLPSOHPHQWHG $VH[SHFWHGPRVWRIWKHPH[SUHVVHGWKHGHVLUHIRUDFFHVVLQJWKHDFDGHPLFPDWHULDOV,QWKLVZD\ WKH\FRXOGGRZQORDGXSORDGDQGFRQVXOWWKHPUHFHLYLQJEHWWHUVXSSRUWIRUWKHLUDFDGHPLFOLIH 7KHUHZHUHDOVRQHZLGHDVEHLQJSURSRVHG6RPHUHTXHVWHGWRKDYHWKH3RSXSQHZVDERXWFRXUVHV
25 RUJHQHUDOLQIRUPDWLRQLHGHDGOLQHWHDFKHULVVLFNRWKHUVZRXOGOLNHWRSD\WKHPHDOVWKURXJK WKHDSSOLFDWLRQDQGKDYHDSXEOLF³&+$7´ZKHUHWKH\FRXOGFRPPXQLFDWHLQWHUDFWVKDUHQRWHVDQG DVNLQIRUPDWLRQ$QRWKHUSDUWLFLSDQWRQHDVNHGIRUDQLQWHUQDOGURSER[WRVWRUHDQGVKDUH GRFXPHQWV:KLOHDQRWKHURQHDVNHGIRUWKHLQWHUDFWLYHPDSRIWKHXQLYHUVLW\DQGDOOWKHPHQXVRI EDUVDQGFDQWHHQ$OORIWKHSDUWLFLSDQWVJDYHWKHVHVXJJHVWLRQVEHFDXVHWKH\VWURQJO\EHOLHYHWKDW WKH\ZRXOGSRVLWLYHO\LQIOXHQFHWKHVWXGHQWV¶DGRSWLRQ 'HVSLWHWKHYDULHW\RIVXJJHVWLRQVSDUWLFLSDQWVZHUHFOHDUO\SRLQWLQJRXWWKDWWKHPDLQ GHVLUHGIXQFWLRQDOLW\ZRXOGEHWRDOORZWKHPWKHDFFHVVWRWKHFRXUVHVPDWHULDO$SSHQGL[ $IWHUZDUGVWKHLQWHUYLHZHUVWDUWHGVKRZLQJDQGGHVFULELQJWKHPRFNXSRIHDFKVHUYLFHRQH E\RQHDQGIRUHDFKRIWKHPDVNLQJ³:KDWLV\RXURSLQLRQ"'R\RXOLNHWKHLGHD":RXOG\RXOLNH WRDGGDQ\VXJJHVWLRQ":RXOG\RXOLNHWRLPSOHPHQWLW":LOOLWDIIHFW\RXUDGRSWLRQ"*LYHDVPDQ\ LQVLJKWVDV\RXFDQ³ 67$<6 )LJXUH6WD\V0RFNXS 2QHRIWKHILUVWREVWDFOHIRUWKHVWXGHQWVPRYLQJLQWKHQHZ XQLYHUVLW\LVWRILQGDSODFHZKHUHWROLYH7KLVLVDPDUNHWSODFHIRU VKDUHGIODWVDQGURRPVIURPVWXGHQWVIRUVWXGHQWVVRZKHQ\RX ZDQWWRPRYH\RXFDQHDVLO\FKHFNIHHGEDFNIURPSDVWVWXGHQWVDQG LQIRUPDWLRQ
26
One of the first obstacle for the students moving in the new university is to find a place where to live. This is a marketplace for shared flats and rooms from students for students, so when you want to move you can easily check feedback from past students and information.
Nine had a positive reaction to it, noticing that there was not a big advantage for the Portuguese students but a big advantage brought in for the new students coming from outside of Lisbon, especially for the internationals. For this reason, STAYS service was defined as useful to welcome the students and therefore it would influence the initial adoption of the application. Very important would be to communicate this before the arrival of the students at the university.
Some suggested to implement the service on the website too, maybe more functional with because of a bigger screen, where it is good to receive internal feedback from the students. Even though, it has been evidenced that many students are using Uniplaces, which could be a competitor or a partner/collaborator to develop it together.
In addition, the only participant that had a negative reaction, a non-user, introduced a new point of view that was not considered before. To whom belongs the responsibility if something goes wrong? It could affect negatively the image of the university (Suggesting as a solution a
collaboration with Uniplaces or Airbnb).
Hence, in this case, the different perception of the service is influenced from their
nationality. In fact, Internationals were very enthusiastic of this idea, on the other hand Portuguese students, recognize the benefit, but it will not influence their adoption. As underlined before, this service will be particularly useful to introduce the new students to the application and to the University (Appendix 13).
27 (9(176 )LJXUH(YHQWV0RFNXS 6WXGHQWVGXULQJWKHLUDFDGHPLFOLIHVSHQGDORWRIWKHLUWLPHDWWKH 8QLYHUVLW\%XWYHU\RIWHQWKH8QLYHUVLW\GRQRWVXSSRUWWKHLUGDLO\ OLIHRXWVLGHRILWRULILWGRHVLWLVDOZD\VUHODWHGWRWKHDFDGHPLF HQYLURQPHQW6RZK\QRWWRWU\WRKHOSWKHPVXJJHVWLQJHYHQWV SDUWLHVWUDYHO«GLUHFWO\RQWKHLUKDQGV"(VSHFLDOO\HYHQWV DGGUHVVHGWRVWXGHQWVDUHZHOFRPHGWRUHDFKWKHWDUJHWSHUIHFWO\ )RUWKLVVHUYLFHWKHJHQHUDOUHDFWLRQZDVSRVLWLYHHYHQWKRXJKRQHKDGDQHJDWLYH GHFODUDWLRQDERXWLWVWDWLQJLWZDVQ¶WQHFHVVDU\EHLQJWKDW)DFHERRNFRXOGSURYLGHWKHVDPHVHUYLFH 2QHPRUHWLPHLWKDVEHHQKLJKOLJKWHGKRZXVHIXOFRXOGEHIRUWKHLQWHUQDWLRQDOVWXGHQWV$PRQJ WKHRQHVZKROLNHGLWXVHUVDQGQRQXVHUVPHQWLRQHGWKDWLWLVDJRRGIXQFWLRQDOLW\EXWLWLV LPSRUWDQWWRGHDOZLWKWKHFRPSHWLWLRQ)DFHERRNZKHUHPDQ\JURXSVDQGHYHQWVDUHVXJJHVWHG7R FRSHZLWKWKH)DFHERRNFRPSHWLWLRQDQGPDNHWKHLGHDPRUHUHOLDEOHFROODERUDWLRQZLWKWKH 6WXGHQW¶V$VVRFLDWLRQRUWKH,QWHUQDWLRQDO&OXEKDVDOVREHHQVXJJHVWHG(YHQWKRXJKLILWZLOOVWLOO EHGHYHORSHGLWKDVWREHGRQHLQDGHWDLOHGZD\OLVWHQLQJWRWKHLUSHFXOLDUQHHGV)RUH[DPSOHLWLV LPSRUWDQWWKDWWKHDSSOLFDWLRQKDVQRVSDPWKDWLVV\QFKURQL]HGZLWKWKHDFDGHPLFFDOHQGDU )XUWKHUPRUHWZRQRQXVHUVSRLQWHGWRVRPHQHZYDOXHVFUHDWHGIRUDOOWKHVWXGHQWV7KLV VHUYLFHFRXOGEULQJDEHWWHUXQLYHUVLW\H[SHULHQFHDQGDVWURQJHUFRPPXQLW\VRFLDOYDOXH,WZLOO DOORZWKHVWXGHQWFRPPXQLW\WRVKDUHH[WUDFXUULFXODUH[SHULHQFHVDOOWRJHWKHUPDNLQJWKH&DWyOLFD /LVERQ6FKRRORI%XVLQHVVDQG(FRQRPLFV¶VWXGHQWLQWHUDFWLRQPRUHLQWHUDFWLYH )LQDOO\WKLVVHUYLFHFRXOGUHDOO\LQIOXHQFHDGRSWLRQVHYHQRXWRIWHQVXVWDLQHGWKDWLWZLOO LQIOXHQFHWKHDGRSWLRQPD\EHPDLQO\IRUWKHLQWHUQDWLRQDOVWXGHQWV$SSHQGL[
28 )/($0$5.(7 6WXGHQWVWKDWPRYHVIRUWKHILUVWWLPHLQDQHZFLW\WRDWWHQGWKHXQLYHUVLW\ QHHGWREX\VRPHXVHIXOVWXIIDWORZSULFHJXLWDUVXUIERDUGERRNVELNH «7KLVIHDWXUHZLOOEHDVHFRQGKDQGPDUNHWZKHUHVWXGHQWVFDQEX\ DQGVHOOWKHLUVWXIIIURPIXUQLWXUHWRERRNV(VSHFLDOO\XVHIXOIRUVWXGHQWV EHFDXVHRIQRORZLQFRPH 7KHUHZDVDJDLQDSRVLWLYHUHDFWLRQWRWKLVVHUYLFHIURPWKHPDMRULW\7KH\SHUFHLYHGLWDVD QHZLGHDYDOXH6RPHSDUWLFLSDQWVWKUHHQRQXVHUVDQGRQHXVHUZHUHSOHDVHGWRREVHUYHKRZD ELJYDOXHEHQHILWFRXOGE\WKHVHPHDQVEHEURXJKWLQIRUHYHU\ERG\UHJDUGLQJDQLQWHUQDWLRQDO PDUNHWIRUERWK3RUWXJXHVHDQGIRUHLJQVWXGHQWV(YHQWKRXJKWZRVXSSRUWHUVRIWKHLGHDSRLQWHG RXWWKDWWKHVHUYLFHLVEDVHGRQDVPDOOPDUNHW&DWyOLFD/LVERQ6FKRRORI%XVLQHVVDQG (FRQRPLFVDQGLWZLOOUHTXLUHDELJJHUXVHUV¶FRPPXQLW\WREHHIILFLHQWDQGPRUHDSSHDOLQJ PD\EHFRPELQLQJDOOWKHXQLYHUVLW\FRPPXQLWLHV,QWKHRWKHUKDQGRQHRIWKHXVHUVXQGHUOLQHGWKDW HYHQLILWLVDVPDOOHUPDUNHWDQGPD\EHQRWDEOHWRVDWLVI\DOOWKHEX\HU¶VQHHGVLWFRXOGEHDVDIHU SRLQWRISXUFKDVHWKDQ2/; ,QVWHDGMXVWRQHQRQXVHUZDVYHU\RSSRVHGWRLWVD\LQJWKDWQRRQHZLOOXVHLWEHFDXVHWKH PDUNHWLVWRRVPDOOWRFDSWXUHWKHRSSRUWXQLW\ZKHUH2/;ZRXOGEHSUHIHUUHG(VVHQWLDOO\KH SHUFHLYHGLWDVXVHOHVV (YHQLIRQHSDUWLFLSDQWZDVDJDLQVWLWWKH)/($0$5.(7GLGQ¶WKDYHFOHDUXWLOLW\ SHUFHSWLRQPD\EHLWKDVQRWVHHQDVHVVHQWLDOHQRXJKWRLQFUHDVHWKHDGRSWLRQRIWKHDSSOLFDWLRQ $SSHQGL[
29 $IWHUHYDOXDWLQJWKHVHUYLFHVWKDWPLJKWEHWWHULQIOXHQFHWKHVWXGHQWOLIHH[SHULHQFHRWKHUWKUHH VHUYLFHVZHUHSURSRVHG,QWKLVFDVHWKHWKUHHVHUYLFHVZHUHFORVHO\UHODWHGWRWKHLUDFDGHPLFOLIH &+$7 )LJXUH&KDWV0RFNXS (YHU\VWXGHQWNQRZVWKHSUREOHPRIFRPPXQLFDWLQJZLWKWKHLU JURXSWHDPWRH[FKDQJHDQGVKDUHGDWDRYHUDVRFLDOQHWZRUNRU :KDWV$SSLQVWHDGRIFRPPXQLFDWLQJWKURXJKWKHQRQH[LVWLQJ8QLYHUVLW\ FKDWZKLFKZRXOGEHHDVLHUDQGXVHUIULHQGOLHUWKDQGRLQJLWRYHUVRFLDO QHWZRUNV7KDWLVWKHQHHGZHZDQWWRVDWLVI\ZLWKDFRPPXQLFDWLRQ IHDWXUHZKHUHVWXGHQWVFDQLQWHUDFWDQGVKDUHJURXSZRUNGDWDWRVSHFLDO PHPEHUVFRXUVHVFKDWRIILFHVSURIHVVRUV« 7KHUHDFWLRQWRWKLVVXJJHVWLRQSURYHGWREHYHU\HQWKXVLDVWLF$OORIWKHPZHUHKDSS\WR KHDUDERXWWKLVIXQFWLRQDOLW\$VZHKDYHVHHQLWZDVRQHRIWKHGHVLUHGIHDWXUHVSURDFWLYHO\ PHQWLRQHGEHIRUH7KHPDMRULW\ZRXOGOLNHWRLQWHJUDWHLWLQ0\&DWROLFD,WKDVILQDOO\EHHQ SHUFHLYHGWKHHQKDQFHPHQWRIWKHFRPPXQLFDWLRQYDOXH0RUHRYHUWKH\ZRXOGOLNHWRKDYHLW DYDLODEOHDOVRRQWKHLUODSWRS7KH\DOVROLNHGWKHEHQHILWVLQWURGXFHGE\WKHQHZWHFKQRORJ\WKDW ZLOOVXEVWDQWLDOO\RSWLPL]HWKHLQWHUDFWLRQDVJURXS¶VFRXUVHDXWRPDWLFDOO\VHWWOHG,WKDVDOVREHHQ SHUFHLYHGDUHODWLYHDGYDQWDJHLQFRPSDULVRQWR0RRGOHPDLOVEHFDXVHWKHUHZLOOEHDIDVWHU FRPPXQLFDWLRQH[SORLWLQJWKHIXQFWLRQDOLW\DQGSRUWDELOLW\EHQHILWVRIWKHWRRO$GGLWLRQDOO\WKUHH QRQXVHUVH[SUHVVHGWKHGHVLUHWRV\QFKURQL]HLWZLWK0RRGOHLQRUGHUWRPDNHLWFRPSOHWHDQG FRQVLVWHQWO\XVHIXOFRPSDWLELOLW\GRPDLQ 7KLVVHUYLFHZLOOLQWURGXFHPDQ\EHQHILWVIRUWKHLUGDLO\DFDGHPLFOLIH,WZLOOFRQVLVWHQWO\ LQIOXHQFHWKHDGRSWLRQ0DQDJHPHQWRUJDQL]DWLRQDOHIILFLHQF\DQGFRPPXQLFDWLRQYDOXHVDUHVHHQ DVDQLQIOXHQWLDODQGVWURQJYDOXHWKDWZLOODIIHFWWKHDGRSWLRQE\QLQHRIWKHSDUWLFLSDQWV )XUWKHUPRUHWKHDGRSWLRQZLOODOVREHDIIHFWHGE\LWVVRFLDOLQIOXHQFH 2QHQRQXVHULQVWHDGGHFODUHGWKDWLWZLOOQRWEHSHUVRQDOO\LQIOXHQFHGEHFDXVHRIKLVKDELWV UHVLVWDQFHGRPDLQ$SSHQGL[
30 &/28' )LJXUH&ORXGV0RFNXS +RZPDQ\WLPHVWXGHQWVIRUJRWDSDSHUGRFXPHQW1RZVWXGHQWVFRXOG KDYHWKHSRVVLELOLW\WRDFFHVVDOOWKHDFDGHPLFPDWHULDOUHVRXUFHLQWKHLU KDQGUHDG\WRXVHLWVOLGHVSGIUHSRUWSUHVHQWDWLRQSDSHUV« $ERXWWKH&/28'VHUYLFHWKHPDMRULW\KDGDSRVLWLYHUHDFWLRQ7KHQWKHRQHVZKROLNHGLW WKHDFFHVVWRWKHPDWHULDOWKURXJKWKHPRELOHGHYLFHZDVGHVLUHG,WZRXOGEULQJQHZYDOXHVDQG ELJJHUHGXFDWLRQDODQGRUJDQL]DWLRQDOEHQHILWV7KLVVHUYLFHPDGHRQHVWXGHQWSHUFHLYHWKH XQLYHUVLW\ZDVEHFRPLQJGLJLWDOLQIOXHQFLQJDOVRLWVLPDJH 2QWKHRWKHUKDQGWZRKDGDQHJDWLYHSHUFHSWLRQRQHXVHUDQGRQHQRQXVHU:KLFKZDV LQIOXHQFHGE\WKHUHVLVWDQFHGRPDLQ,QWKLVFDVHWKHODSWRSLVSUHIHUUHGWRWKHPRELOHGHYLFH7KLV NLQGRIVHUYLFHZLOOLQFUHDVHWKHDGRSWLRQIRURIWKHSDUWLFLSDQWV,WLVHQKDQFLQJWKHLUDFDGHPLF DQGVWXGHQWOLIH,WKDVEHHQWDNHQLQDFFRXQWDVYHU\XVHIXO$VWXGHQWKDVDOVRIRUHVHHQDOLWWOH LQIOXHQFHLQKLVOHDUQLQJSURFHVVIRUH[DPSOHPDNLQJSRVVLEOHDUHYLVLRQIDVWFKHFNRIWKH GRFXPHQWVZKLOHLQWKHPHWUR )RUWKHRWKHUWZRRQHXVHUDQGRQHQRQXVHUWKHUHDVRQZK\LWZLOOQRWDIIHFWWKHLUDGRSWLRQ DQGPD\EHWKHDGRSWLRQRIWKHLUSHHUVLVEHFDXVHRIWKHLUKDELWV7KLVUHPLQGVWKH5HVLVWDQFH GRPDLQEHFDXVHWKH\DUHXVHGWRZRUNDQGVWXG\RQWKHLUODSWRSDQGWKH\ZRQ¶WFKDQJHWKHLU URXWLQHDSSURDFK$SRVVLEOHVROXWLRQWRIDFHZLWKWKHUHVLVWDQFHREVWDFOHWKHQLVWRSURYLGHWKLV VHUYLFHV\QFKURQL]HGZLWKWKHODSWRSSODWIRUPV,QWKLVZD\LWZLOOEHVDWLVILHGWKHQHHGRIWKHRQHV XVHGWRDFFHVVWKHGRFXPHQWMXVWRQWKHODSWRSPDNLQJWKHDSSOLFDWLRQDQGWKHSODWIRUPVPRUH FRPSOHPHQWDU\$SSHQGL[
31 127( )LJXUH1RWHV0RFNXS 7KLVLVDQLQQRYDWLYHVHUYLFHWKDWZLOOKHOSVWXGHQWVLQWDNLQJQRWHLQD YDQJXDUGZD\,IDOXPQDFDQ¶WHDVLO\DFFHVVFRQVXOWWKHLUQRWHVSLFVRI WKHERDUGZLWKWKHLUPRELOHWDNLQJV\VWHPWKHPRELOHGHYLFHORVHWKH RSSRUWXQLW\RIEHLQJXVHIXOGXULQJWKHFODVV6RZK\QRWV\QFKURQL]H QRWHVSLFVDXGLRYLGHR«LQDWHFKQRORJLFDOQRWH"$LQQRYDWLYHQRWH WDNLQJV\VWHPRIWKH8QLYHUVLW\ ,QWKLVFDVHVL[UHVSRQGHQWVKDGDSRVLWLYHUHDFWLRQWKUHHXVHUVDQGWKHWKUHHQRQXVHUVDQG IRXUKDGDQHJDWLYHRQH7KHVL[UHVSRQGHQWVZHUHPDLQO\FXULRXVDERXWLWEXWWKH\ZHUHDOUHDG\ QRWLFLQJWKDWLWFRXOGEULQJQHZHGXFDWLRQDOOHDUQLQJDQGPDQDJHPHQWYDOXHVWRWKHLUDFDGHPLFOLIH +RZHYHULWKDVWREHTXLFNFRQQHFWHGZLWKWKHODSWRSDQGWKHHDVHRIXVHLVUHTXLUHG,QWKLVFDVH VLQFHLWLVDQHZWHFKVHUYLFHQHYHUH[SHULHQFHGEHIRUHDWULDORILWZRXOGEHQHFHVVDU\ 7KHIRXUWKDWZHUHGLVOLNHGWKLVLGHDZHUHDGGUHVVLQJWKHFDXVHWRWKHLU³KDELWV´7KH\DUH QRWXVHGWRWDNHQRWHVZLWKDQ\WHFKQRORJLFDOGHYLFHMXVWSDSHU7KHUHIRUHWKH\GRQRWVHHEHQHILW WRWKHLUGDLO\OLYHVDVVWXGHQWV3OXVLWKDVWREHVXSSRUWHGDOVRE\WKHSURIHVVRUEHFDXVHRIWHQWKH\ GRQRWDOORZVWXGHQWVWRXVHPRELOHGHYLFHV 7KLVZRXOGEHDQHZVHUYLFHWKDWFRXOGUHDOO\EULQJDGYDQWDJHVIRUWKHVWXGHQWV+RZHYHU WKHGRPDLQVWKDWFRXOGDIIHFWWKHLUDGRSWLRQ5HVLVWDQFH(DVHRIXVHFDQQRWEHIRUJRWWHQ $SSHQGL[ WKHGRPDLQVWKDWFRXOGDIIHFWWKHLUDGRSWLRQ5HVLVWDQFH(DVHRIXVHFDQQRWEHIRUJRWWHQ &ORVLQJTXHVWLRQV 7RFRQFOXGHWKHH[SORUDWRU\SDUWWKHSDUWLFLSDQWVZHUHDVNHGWRJLYHDILQDORSLQLRQDERXW 0\&DWROLFDDQGWKHLQWHJUDWHGVHUYLFHVSURSRVHG ³:KDWGR\RXWKLQNDERXWWKH0\&DWROLFDDWWKLVSRLQW"´