Para consolidar a proposta sugerida neste trabalho como um resultado concreto, um artigo resumindo o algoritmo apresentado e os resultados obtidos foi submetido e aceito para publicação em conferência internacional:
• Leonardo R. S. Campos, Rodrigo D. Oliveira, Jorge D. Melo and Adrião D. Dória Neto. Overhead-Controlled Routing in WSNs with Reinforcement Learning.
Intelligent Data Engineering and Automated Learning – IDEAL 2012. Aceito para publicação.
Referências Bibliográficas
Akyildiz, I.F., W. Su, Y. Sankarasubramaniam & E. Cayirci (2002), ‘Wireless sensor networks: a survey’, Computer Networks 38(4), 393–422.
*http://www.sciencedirect.com/science/article/pii/S1389128601003024
Al-karaki, Jamal N. & Ahmed E. Kamal (2004), ‘Routing techniques in wireless sensor networks: A survey’, IEEE Wireless Communications 11, 6–28.
Barbancho, Julio, Carlos León, F.J. Molina & Antonio Barbancho (2007), ‘Using artificial intelligence in routing schemes for wireless networks’, Computer Communications
30(14-15), 2802 – 2811. <ce:title>Network Coverage and Routing Schemes for
Wireless Sensor Networks</ce:title>.
*http://www.sciencedirect.com/science/article/pii/S0140366407002095
Boyan, Justin A. & Michael L. Littman (1994), Packet routing in dynamically chan- ging networks: A reinforcement learning approach, em J. D.Cowan, G.Tesauro & J.Alspector, eds., ‘Advances in Neural Information Processing Systems’, Vol. 6, Morgan Kaufmann Publishers, Inc., pp. 671–678.
*http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.40.1750
Bruneo, Dario, Marco Scarpa, Andrea Bobbio, Davide Cerotti & Marco Gribaudo (2009), Analytical modeling of swarm intelligence in wireless sensor networks through mar- kovian agents, em ‘Proceedings of the Fourth International ICST Conference on Per- formance Evaluation Methodologies and Tools’, VALUETOOLS ’09, ICST (Insti- tute for Computer Sciences, Social-Informatics and Telecommunications Enginee- ring), ICST, Brussels, Belgium, Belgium, pp. 52:1–52:10.
*http://dx.doi.org/10.4108/ICST.VALUETOOLS2009.7672
Faruque, Jabed & Ahmed Helmy (2003), ‘Gradient-based routing in sensor networks’,
SIGMOBILE Mob. Comput. Commun. Rev. 7, 50–52.
*http://doi.acm.org/10.1145/965732.965742
Gan, Long, Jiming Liu & Xiaolong Jin (2004), Agent-based, energy efficient routing in sensor networks, em ‘Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 1’, AAMAS ’04, IEEE Computer Society, Washington, DC, USA, pp. 472–479.
*http://dx.doi.org/10.1109/AAMAS.2004.53
Hu, Yih-Chun & David B. Johnson (2000), Caching strategies in on-demand routing pro- tocols for wireless ad hoc networks, em ‘Proceedings of the 6th annual international
conference on Mobile computing and networking’, MobiCom ’00, ACM, New York, NY, USA, pp. 231–242.
*http://doi.acm.org/10.1145/345910.345952
IEEE, Standard (2006), Wireless Medium Access Control (MAC) and Physical Layer
(PHY) Specifications for Low-Rate Wireless Personal Area Networks (WPANs),
IEEE Computer Society. Revision of IEEE Std 802.15.4-2003.
Intanagonwiwat, Chalermek, Ramesh Govindan & Deborah Estrin (2000), Directed dif- fusion: a scalable and robust communication paradigm for sensor networks, em ‘Proceedings of the 6th annual international conference on Mobile computing and networking’, MobiCom ’00, ACM, New York, NY, USA, pp. 56–67.
*http://doi.acm.org/10.1145/345910.345920
Intanagonwiwat, Chalermek, Ramesh Govindan, Deborah Estrin, John Heidemann & Fa- bio Silva (2003), ‘Directed diffusion for wireless sensor networking’, IEEE/ACM
Trans. Netw. 11, 2–16.
*http://dx.doi.org/10.1109/TNET.2002.808417
Lin, Ruizhong, Zhi Wang & Youxian Sun (2004), Energy efficient medium access control protocols for wireless sensor networks and its state-of-art, em ‘Proc. IEEE Internati- onal Symposium on Industrial Electronics’, Vol. 1, pp. 669– 674. Energy efficiency. Misra, Devendra K. (2004), Radio-Frequency and Microwave Communication Circuits:
Analysis and Design, secondaedição, Wiley-Interscience.
Ouferhat, Nesrine & Abdelhamid Mellouk (2010), Inductive routing based on energy and delay metrics in wireless sensor networks, em ‘Proceedings of the 6th Internatio- nal Wireless Communications and Mobile Computing Conference’, IWCMC ’10, ACM, New York, NY, USA, pp. 1121–1125.
*http://doi.acm.org/10.1145/1815396.1815653
Perkins, C.E. & E.M. Royer (1999), Ad-hoc on-demand distance vector routing, em ‘Mo- bile Computing Systems and Applications, 1999. Proceedings. WMCSA ’99. Se- cond IEEE Workshop on’, pp. 90 –100.
Puterman, Martin L. (1994), Markov Decision Processes: Discrete Stochastic Dynamic
Programming, John Wiley and Sons.
Rao, Vaddina & Dimitri Marandin (2006a), Adaptive backoff exponent algorithm for zigbee (ieee 802.15.4), pp. 501–516.
*http://dx.doi.org/10.1007/11759355_46
Rao, Vaddina P. & Dimitri Marandin (2006b), ‘Adaptive Channel Access Mechanism for Zigbee (IEEE 802.15.4)’, Journal of Communications Software and Systems
REFERÊNCIAS BIBLIOGRÁFICAS 41
Ros, Francisco J. & Pedro M. Ruiz (2004), Implementing a New Manet Unicast Rou-
ting Protocol in NS2, Department of Information and Communications Engineering,
University of Murcia, Spain.
Shah, R.C. & J.M. Rabaey (2002), Energy aware routing for low energy ad hoc sen- sor networks, em ‘Wireless Communications and Networking Conference, 2002. WCNC2002. 2002 IEEE’, Vol. 1, pp. 350 – 355 vol.1.
Silva, Diego, Adrião Duarte Dória Neto & Jorge Dantas de Melo (2004), Uso do algo- ritmo q-learning para roteamento em redes ad-hoc, em ‘8th Brasilian Symposium on Neural Networks’.
Stallings, William (2001), Wireless Communications and Networking, Prentice Hall. Sutton, Richard S. & Andrew G. Barto (1998), Reinforcement Learning: An Introduction,
MIT Press, Cambridge, MA, USA.
*http://portal.acm.org/citation.cfm?id=551283
Tynan, Richard, David Marsh, Donal O’Kane & G. M. P. O’Hare (2005), Intelligent agents for wireless sensor networks, em ‘Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems’, AAMAS ’05, ACM, New York, NY, USA, pp. 1179–1180.
*http://doi.acm.org/10.1145/1082473.1082682
Verdone, Roberto, Davide Dardari, Gianluca Mazzini & Andrea Conti (2008), Wireless
Sensor and Actuator Networks, Academic Press.
Wang, Ping & Ting Wang (2006), Adaptive routing for sensor networks using reinforce- ment learning, em ‘Proceedings of the Sixth IEEE International Conference on Com- puter and Information Technology’, CIT ’06, IEEE Computer Society, Washington, DC, USA, pp. 219–.
*http://dx.doi.org/10.1109/CIT.2006.34
Watkins, Christopher J. C. H. & Peter Dayan (1992), ‘Q-learning’, Machine Learning
8(3), 279–292.
*http://dx.doi.org/10.1007/BF00992698
Wooldridge, Michael (2009), An Introduction to MultiAgent Systems, 2ndaedição, Wiley
Publishing.
Yadav, Rajesh, Shirshu Varma & N. Malaviya (2009), ‘A survey of mac protocols for wireless sensor networks’, UbiCC Journal 4(3), 827–833. Survey.
*http://www.ubicc.org/files/pdf/11_339.pdf
Ye, Fan, A. Chen, Songwu Lu & Lixia Zhang (2001), A scalable solution to minimum cost forwarding in large sensor networks, em ‘Computer Communications and Networks, 2001. Proceedings. Tenth International Conference on’, pp. 304 –309.
Yick, Jennifer, Biswanath Mukherjee & Dipak Ghosal (2008), ‘Wireless sensor network survey’, Comput. Netw. 52, 2292–2330.
*http://dl.acm.org/citation.cfm?id=1389582.1389832
Zheng, Jianliang & Myung J. Lee (2004), A comprehensive performance study of ieee 802.15.4. City University of New York.
Apêndice A
Listagem dos Códigos-fonte
Este apêndice contém os principais trechos de código implementados neste trabalho.
A.1 Estrutura do Pacote
Definição da estrutura do pacote de feedback, o único definido pelo QRouting.