Supervisor: Dr Samit Bhattacharya

We are currently living in what can arguably be called the "information age". One of the main characteristics of the age is to allow individuals to have instant access to information. Such information can be multi-faceted ranging from latest stock-market data to information related to the health-care facilities available in one's locality. The technology that emerged over time to be one of the primary sources for the individuals to access information is the World Wide Web (WWW). The two major actors in the WWW-based information dissemination process are (a) the information provider and (b) the information user. The "interface" between these two is a "webpage" displayed on a web browser such as Mozilla Firefox, Internet Explorer etc. Evidently, it is of utmost importance that the information provider design the webpage in a way such that the information user finds it easy to locate the information; in other words, a "usable" interface. If a webpage is badly designed, the user may lose interest in locating information contained in the web page. Consequently, the very objective of an information provider to put up web pages will be lost. This may have both economic as well as social consequence. For example, if the user loses interest in viewing the home page of a company, the company may be losing potential customers in spite of having good products. On the other hand, if the user is not interested to view a government web page containing information about various schemes available for the rural people (an e-governance activity), the loser will be the intended segment (rural population) of the society. Keeping this in mind, we aim to model web page usability in terms of "visibility". Visibility is a measure of attention the user is expected to give to particular object/regions on the web page. The visibility model will rank different objects/regions on the page in terms of their visibility to a user. From this ranking, a designer can find out if the most important information on the webpage has the highest visibility. It is also envisaged to produce a visual output of the web page, where objects/regions are marked with different colors according to their visibility. The visual output is expected to make the job of the designer easier. At present, web pages are designed using either of the several available tools such as Microsoft FrontPage, Microsoft Publisher, DreamWeaver etc., none of which checks for the usability of the designed page. A semi-automatic design process can be envisaged as consisting of a tool to check automatically the source program of a web page (output of the existing tools) for any potential visibility problems. The system then draws the designer's attention to these problems in a usable form, so that the designer can understand and rectify the problems.

Students

PhD:

• Sandep Vidyapu (Supervisor: Dr Samit Bhattacharya and Dr V Vijaya Saradhi)

Graduate/undergraduate students:

• Vishnu Swaroop Priyansh (graduated) studies
• Ananya Jana (graduated)
• Sudhakar Kumar (graduated)
• Ganesh Khade (graduated)

• Vidyapu, S., Vedula, VS., Bhattacharya, S. (2019). Quantitative visual attention prediction on webpage images using multiclass SVM, Proc. of the 11th ACM Symposium on Eye Tracking Research & Applications, Denver, Colorado, June. 2019, pp. 90
• Vidyapu, S., Vijaya Saradhi, V. & Bhattacharya, S. (2020). Weighted-Voting-based Effective Visual Attention Prediction on Web Image Elements. Interacting with Computers (IwC) (accepted)
• Vidyapu, S., Vijaya Saradhi, V. & Bhattacharya, S. (2020). Investigating and Modeling the Web Elements Visual Feature Influence on Free-viewing Attention. ACM Transactions on the Web (ACM TWEB) (accepted)
• Vidyapu, S., Vijaya Saradhi, V., Burch, M & Bhattacharya, S. (2020). Attention-based Cross-Modal Unification of Visualized Text and Image Features: Understanding the influence of interface and user idiosyncrasies on unification for free-viewing. Proc. 12th ACM Symposium on Eye Tracking Research & Applications (ETRA 20 adjunct), pp. 29:1-29:9.
• Kondaveeti, S. A., Vidyapu, S. & Bhattacharya, S. (2016). Improved Gaze Likelihood based Web Browsing. Proc. 8th int conf Human-Computer Interaction (IndiaHCI 2016), Mumbai, India, pp 84-89.
• Khade, G., Kumar, S. & Bhattacharya, S. (2012). Classification of Web Pages on Attractiveness: A Supervised Learning Approach. Proc. 4th Int. Conf. Intelligent Human Computer Interaction (IHCI 2012), Kharapur, India, pp. 550-554.
• Priyansh, V. S. & Bhattacharya, S. (2012). Predictive Attention Modeling for Web Page Users. The 10th Asia Pacific Conference on Computer Human Interaction (APCHI 2012), Matsue, Japan, pp. 737-738.
• Jana, A., & Bhattacharya, S. (2015). Design and validation of an attention model of web page users. Advances in Human-Computer Interaction(AHCI), pp. 1.

Supervisor: Dr T Venkatesh

This project aims to develop mechanisms to improve the quality of experience of users in online streaming systems based on peer-to-peer overlays or peer-assisted content distribution networks. To improve the end-to-end delay in multimedia streaming, this work focuses on peer selection strategies, caching strategies at the peers, and optimized overlay construction. Since end-to-end delay is seen as the main factor in improving the user experience in online streaming, both overlay construction and peer selection strategies would be enhanced to reduce the delay.

Students

PhD:

• Hema Kumar Yarnagula (Supervisor: Dr T. Venkatesh)
• Shilpa Budhkar (Supervisor: Dr T. Venkatesh)
• Parikshit Juluri (University of Missouri Kansas City)

Graduate/undergraduate students:

• Krishna Mohan Agrawal (graduated)
• Rupesh Koshariya (graduated)

• Varma, M., Yarnagula, H. K., & Tamarapalli, V. (2017). WebRTC-based Peer Assisted Framework for HTTP Live Streaming. Proc. of 9th International Conference on Communication Systems and Networks (COMSNETS), Bengaluru, India.(Best Poster Award)
• Yarnagula, H. K., & Tamarapalli, V., The HTTP/2 Server Push and its Implications on Mobile Web Quality of Experience", Proc. of 25th National Conference on Communications (NCC), IISc Bangalore, Feb. 2019.
• Yarnagula, K. H., Anandi, R., & Tamarapalli, V. (2019). Objective QoE Assessment of DASH Adaptation Algorithms over Multipath TCP, Proc. of 11th International Conference on Communication Systems and Networks (COMSNETS), Bengaluru, India, Jan. 2019
• Yarnagula, H. K., Juluri, P., Mehr, S. K., Tamarapalli, V., & Medhi, D. (2019). QoE for Mobile Clients with Segment-aware Rate Adaptation Algorithm (SARA) for DASH Video Streaming. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 15(2), pp. 36
• Yarnagula, H.K. and Tamarapalli, V., (2020). Adaptive Prefetching at Network Edge to Improve DASH QoE. In Proceedings of the 21st International Conference on Distributed Computing and Networking,January, 2020, pp. 1-1
• Yarnagula, H. K., Vooda, R. K., & Tamarapalli, V. (2016). A measurement study of energy consumption anc QoE trade-offs for DASH in mobile devices. In Advanced Networks and Telecommunications Systems (ANTS), 2016 IEEE International Conference on, Bengaluru, India, pp. 1-3.
• Yarnagula, H. K., & Tamarapalli, V. (2016). Score-based objective quality of experience assessment of DASH adaptation algorithms. Proc. of IEEE International Conference on Advanced Networks and Telecommunication Systems (ANTS), Bengaluru, India, pp. 1-6. (Best Paper Award)
• Yarnagula, H. K., Luhadia, S., Datta, S., & Tamarapalli, V. (2016). Quality of experience assessment of rate adaptation algorithms in DASH: An experimental study. Proc. of 8th International Conference on Communication Systems and Networks (COMSNETS), Bengaluru, India, pp. 1-8.
• Agrawal, K. M., Venkatesh, T., & Medhi, D. (2014). A dynamic popularity-based partial caching scheme for video on demand service in IPTV networks. In 6th International Conference on Communication Systems and Networks (COMSNETS), Bengaluru, India, pp. 1-8.
• Juluri, P., Tamarapalli, V., & Medhi, D. (2015). Look-ahead rate adaptation algorithm for DASH under varying network environments. In 11th International Conference on Distributed and Reliable Communication Networks, Kansas City, USA, pp. 89-90.
• Juluri, P., Tamarapalli, V., & Medhi, D. (2016). Measurement of quality of experience of video-on-demand services: A survey. IEEE Communications Surveys and Tutorials, 18(1), First quarter, pp.401-418.
• Juluri, P., Tamarapalli, V., & Medhi, D. (2015). SARA: Segment aware rate adaptation algorithm for dynamic adaptive streaming over HTTP. In Communication Workshop (ICCW), 2015 IEEE International Conference on, London, UK, pp. 1765-1770.

Supervisor: DR SAMIT BHATTACHARYA

Affective computing, sometimes known as emotional computing, is one of the most recent and hottest research area in the field of Human-Computer Interaction (HCI). Researchers are trying to incorporate affect and emotion in HCI to make the interaction “sympathetic”, “empathic” or simply “affective”. The obvious ambition is to improve usability and user experience by making the systems more natural and responsive to the goals and expectations of the user. The first and foremost step for designing an affective interactive system is to recognize the affective state of the user. This may be followed by the design and implementation of appropriate interface and interaction that complement and/or change the users’ affective/emotional state. We, the affective computing team of UCCN Lab of IITG are working both on identifying affective state of the users as well as designing affective interactive systems. For identifying affective state of the user, we mainly emphasize to consider the users of small handheld and touchscreen devices including mobile phones and tablets, as explosion of these devices are clearly observable all around us. At the same time, we are developing a sensitive classroom system where the emotional states of the students will be taken care of to make the teaching-learning process more efficient. Based on the emotional and mental states of the students, teaching learning strategies will dynamically be changed to enhance the students’ interest and engagement and hence, the quality of learning. In our ICT based sensitive classroom system, the students will be warned if they were not engaged in the classroom during lecture. They will also be motivated for engagement through some smart module of the system. The instructor will also be alerted if maximum of the students are not engaged or unable to understand what the teacher is teaching, so that s/he can take corrective actions (if required). The learning level and understanding level of the students will also be periodically measured. All these will be done automatically and systematically by the classroom system itself. Once completed, the sensitive classroom will help to enhance the teaching learning method by a strikingly large extent.

Students

PhD:

• Subrata Tikadar (Supervisor: Dr Samit Bhattacharya)

• Tikadar, S. & Bhattacharya, S. (2019). Predicting Students' Involvement in Blended Learning Environment. 19th IEEE International Conference on Advanced Learning Technology (ICALT '19). Maceio, Brazil. pp 76-78. (Best Paper Award)
• Tikadar, S. & Bhattacharya, S. (2019). A Novel Method to Build and Validate an Affective State Prediction Model from Touch-Typing. 17th IFIP TC.13 International Conference on Human-Computer Interaction (INTERACT '19). Paphos, Cyprus. LNCS, vol 11749. Springer, Cham. pp. 99-119.
• Tikadar, S. & Bhattacharya, S. (2019). How Do They Use Their Smartphones: A Study on Smartphone Usage by Indian Students. 17th IFIP TC.13 International Conference on Human-Computer Interaction (INTERACT '19). Paphos, Cyprus. LNCS, vol 11748. Springer, Cham. pp. 132-151
• Tikadar, S., Bhattacharya, S., & Tamarapalli, V. (2018). A Blended Learning Platform to Improve Teaching-Learning Experience. In 18th IEEE International Conference on Advanced Learning Technologies - ICALT 2018, Mumbai, India. pp. 87-89
• Tikadar, S., Kazipeta, S., Ganji, C., & Bhattacharya, S. (2017). A Minimalist Approach for Identifying Affective States for Mobile Interaction Design. In 16th IFIP Conference on Human-Computer Interaction - INTERACT 2017, Mumbai, India, pp. 3-12.
  

  Video Link: Click here

Supervisor: Dr Samit Bhattacharya

The most influential challenge in meaningful visualization is to represent large data sets that satisfy specific user needs. In Human-computer Interaction (HCI), particularly in visualization, there are challenges to designing an adequately simple system concerning better interaction and user experience. The key intuition to design goals in HCI to explore and understand the data by a non-expert user. A good data visualization also concerns the design decisions such as abstraction of data as per user's cognitive ability/load and clustering of data into groups as per useful goals.

We are trying to apply the visualization technique in education settings, particularly in ICT based classroom, to visualize the real-time status of the students. The visualization techniques will help the teacher to explore details about the students' engagement with the teaching-learning. Whether and how many of the students are engaged with the teaching-learning process. The augmented information will help the instructor to decide further corrective actions if required. Currently, we are emphasizing to develop classroom visualization techniques using cluster-based visualization through a limited size display device such as a smartphone/tablet. We are motivated to research this because it is challenging for a teacher to visualize real-time status. The status means which and/or how many in-class students are engaged/understanding, particularly when the classroom is large. We hope that this will significantly improve the teaching-learning process.

We are also working on designing smart warnings for the classroom uses. The warnings/alert or the notifications should be sent in a smartphone/tablet, including peripheral smart-band. The affective computing team of our lab is working to build a sensitive classroom where the students' engagement and understanding level will be identified automatically by using the data from digital backchannel and embedded sensors of smartphones/tablets. Once these have been identified, it is required to alert the students' who are not engaged. It is also necessary to warn the teacher if most of the students are not engaged/not understanding what the teacher is teaching. Systematic alert generation is challenging. The major challenges are

• When and what type of alert should be sent to a particular student(s) without disturbing the other students.
• How frequently the teacher should be alerted without interrupting the flow of the lecture.

Students

PhD:

• Ujjwal Biswas (Supervisor: Dr Samit Bhattacharya)

• Biswas, U. and Bhattacharya, S., 2023. ML-based Intelligent Real-time Feedback System for Blended Classroom", Springer, Education and Information Technologies (accepted)
• Biswas, U. and Bhattacharya, S., 2022. Multimodal Peripheral Alert to Improve Teaching-Learning for Blended Classroom. In ICT Analysis and Applications: Proceedings of ICT4SD 2022 (pp. 703-713). Singapore: Springer Nature Singapore.
• Bhattacharya, S., Shah, V.B., Kumar, K. and Biswas, U., 2021. A real-time interactive visualizer for large classroom. ACM Transactions on Interactive Intelligent Systems (TiiS), 11(1), pp.1-26. DOI: https://dl.acm.org/doi/abs/10.1145/3418529

• Presented in IUI'22. Video Link: https://dl.acm.org/doi/abs/10.1145/3418529

Supervisor: Dr Samit Bhattacharya

Good interface design requires knowledge about people: how they see, understand and think. Another important aspect of good design is how information is visually presented to the user or the aesthetics of the interface. Aesthetically pleasing interfaces improve usability, which implies the improvement in productivity. An interface is composed of the rectangular webpage objects which contain image, text. The positions of these rectangles in the webpage have a direct relation with the aesthetics. Again, the features associated with the text and image affect interface aesthetics.

The specific objectives of our work are

• Design of computational models for aesthetics prediction of webpage elements: text, image
• Design of computational model for aesthetics prediction based on the positions (geometric property) of webpage elements in the layout.
• Design of computational model for aesthetics prediction of a whole webpage by combining the previous two objectives.
• Use of model for design of aesthetically pleasing webpages.

Figure 2 shows an example of IIT Guwahati webpage and its wireframe model, text component and image component. Till date, we developed a computational model for wireframe structure. We also developed a model for images present in an interface. Lastly we developed a computational model for text elements. Currently we are working on integrating these three models to develop a computational model for whole interface.

Students

PhD:

• Ranjan Maity (Supervisor: Dr Samit Bhattacharya)

• Maity, R. & Bhattacharya, S. (2020). A Quantitative Approach to Measure Webpage Aesthetics. International Journal of Technology and Human Interaction (IJTHI), 16(2), pp. 53-68.
• Maity, R., & Bhattacharya, S. (2017). A Model to Compute Webpage Aesthetics Quality Based on Wireframe Geometry. In 16th IFIP Conference on Human-Computer Interaction - INTERACT 2017, Mumbai, India, pp. 85-94.
• Maity, R. & Bhattacharya, S. (2017). Computational Model for Webpage Aesthetics using SVM. Proc 31st British Human Computer Interaction Conference (BCS HCI 2017), Sunderland University, UK (accepted).
• Maity, R., Madrosiya, A. & Bhattacharya, S. (2015). A Computational Model to Predict Aesthetic Quality of Text Elements of GUI. 7th int conf Intelligent Human Computer Interaction (IHCI 2015), Procedia Computer Science, 84, IIIT Allahabad, India, pp. 152-159.
• Maity, R., Uttav, A., Verma, G., & Bhattacharya, S. (2015). A Non-Linear Regression Model to Predict Aesthetic Ratings of On-Screen Images. 27th Australian Conference on Human-Computer Interaction (OzCHI 2015), Melbourne, Australia, pp 44-52.
• Shyam, D. & Bhattacharya, S. (2012). A Model to Evaluate Aesthetics of Short Animations. The 10th Asia Pacific Conference on Computer Human Interaction (APCHI 2012), Matsue, Japan, pp. 315-324.
• Bansal, D. & Bhattacharya, S. (2013). Semi-Supervised Learning based Aesthetic Classifier for Short Animations Embedded in Web Pages. Proc. 14th IFIP TC13 Conference on Human-Computer Interaction (INTERACT 2013), Part I, LNCS 8117, Cape Town, South Africa, pp. 728-745.
• Singh, N. & Bhattacharya, S. (2010). A GA-Based Approach to Improve Web Page Aesthetics. Proc. 1st int. conf. on Intelligent Interactive Technologies and Multimedia (IITM 10), IIIT Allahabad, India, pp. 29-32.

Supervisor: Dr Samit Bhattacharya

Cultural Heritage (CH) is an identity of any group (community or tribe). It provides a sense of bindings and belongingness amongst a group and allows them to have a better understanding of their previous generations and traditional evolutionary history. Cultural Heritage also promotes tourism and acts as a means of cultural exchange between groups. However, traditional preservation methods (museum, live tour with written description) of CH have failed to attract individuals, especially the younger generation. Moreover, restricted access to real-world heritage inhibits users' complete understanding of it. These lead to a lack of proper appreciation of CH amongst observers. These motivated researchers to digitize the Cultural Heritage to preserve them as well as to attract individuals.
The digitization of CH can be achieved using archiving technologies and immersive technologies (Virtual Reality (VR) and Augmented Reality (AR)). The users can get the sense of being immersed in the CH environment with informative content using immersive technologies. In a VR based CH system, the user should feel like being at a site without being physically present there. In order to generate that feeling, the virtual environment should be as realistic as possible. The user should also be able to navigate through the environment naturally. Allowing the user to interact with the virtual content would enhance the user�s sense of belongingness to the environment. The expectations and capabilities vary from user to user, which necessitates the VR based system to be personalized tailored to individual needs. In an AR assisted CH system, the information presented to the user should be easily perceivable. Moreover, it should not hamper the real-world experience of the user. In order to augment the virtual content in a real environment, there should be a fine-tuned blending of virtual and real environments. The user should also be able to interact with those virtual contents naturally, which enhances the user experience. Like VR systems AR systems also necessitates personalization with the user needs.
We have considered three types of users, viz. Live Tour Users, Virtual Tour Users and Mobile Tour Users. Live Tour users being present in-situ, experience CH using smart-glass. Multimedia information is overlaid in the real-life view of the users. Virtual Tour users experience the CH remotely using Head Mounted Display (HMD). The Mobile Tour users, on the other hand, use their handheld mobile devices (smartphones, tablets) to get detailed information about any CH entity.
Our main focus is to make our CH system to give a user the experience of sensing realism and allow the users to interact with the virtual world using controllers or without using controllers (body gestures).

Students

PhD:

• Nilotpal Biswas (Supervisor: Dr Samit Bhattacharya)