Article Versions
Export Article
Cite this article
  • Normal Style
  • MLA Style
  • APA Style
  • Chicago Style
Research Article
Open Access Peer-reviewed

Designing and Testing Electronic Coursebook to Develop Student's Competence in Experimental Practical Methods in Teaching Chemistry at the Universities of Education in Vietnam

Cao Cu Giac , Ly Huy Hoang
World Journal of Chemical Education. 2018, 6(4), 145-153. DOI: 10.12691/wjce-6-4-1
Received August 02, 2018; Revised September 05, 2018; Accepted September 25, 2018

Abstract

This article introduces an electronic coursebook for experimental practical methods in teaching chemistry in attempt to develop pedagogical students’ competence. Four principles, six steps in designing and two ways to use this electronic coursebook for developing pedagogical students’ competence are introduced. Results of pedagogical experiments in teaching the module “Practical experiment about teaching method in chemistry” for third-year students of the courses in 2015-2016 and 2016-2017 at some universities of education in Vietnam have shown the efficiency and the feasibility of using electronic coursebook for pedagogic students in chemistry. The participants of those pedagogical experiments were asked to use the electronic coursebook before chemical experiments in the laboratory were conducted, following four steps: (i) Participants answered objective test questions on the skills to perform experiments in the laboratory, safety notes and successes of the experiment; (ii) Participants carred out simulations of experiments in the syllabus, and observed the setting up apparatuses of laboratory and the sequence of experiments; (iii) Participants carried out experiments in small groups in the laboratory under the supervision of instructors; and (iv) Teachers asked participants to do the available tests in the electronic coursebook to assess their learning outcomes.

1. Introduction

Chemistry is a subject that involves experimentation which could be more exciting whenever conducted through laboratory experiment where the results are more memorable by their senses 1. When simulated chemistry laboratories are implemented effectively, students can have additional opportunities to engage in meaningful pedagogical experiences. Through our evaluation of the inorganic Virtual ChemLab, Brian et al., 2 have found that if effectively used it (i) provides “practical experience” by connecting the “theory” taught in the classroom with the “real world” of the laboratory, (ii) provides a realistic learning environment for different learning styles, and (iii) teaches the cognitive processes (or analytical skills) that form the foundation of chemistry and other laboratory sciences.

Information and communication technology has shown its usefulness and importance in almost every aspect and careers nowadays. With education, the information technology and the media have created “the revolution” in teaching – learning and they are “the key” to increase the quality of education 3. In educational science, teacher can deploy different methods to use information and communication technology efficiently, include: using information and communication technology reasonably to increase the value of study action, linking information and communication technology to teaching and learning, encourage students to share their ideas and find information… 4. Previous studies have shown the benefits of using information and communication technology in chemical education. Here are some of those: Animations and dynamic visualisations 5, 6; CD-ROMs and simulations 7; Computerized molecular modelling 8, 9; Virtual worlds 10; Interactive whiteboard technology 11; Using an interactive software program, Virtual Chemistry Laboratory (VCL) to assess the software's influence on student understanding of some basic organic chemistry laboratory techniques 12; SimuLab computer-based learning environment. The SimuLab is a cognitive tool designed to help students to acquire experimental and analytical skills on the basis of a classical qualitative and quantitative analysis scheme and to develop their ability to interpret experimental results 13.

Results of an attitudinal survey showed that students expressed similarly favorable views of the hands-on and virtual experiments, and they found that report writing was equally challenging for both types of experiments. According to Kurt, Matthew, & Deborah 14, the virtual experiment required significantly less time to complete.

One of ICT’s applications in teaching today is designing for electronic coursebook. Various authors have published ebooks 15 or created the websites to support for students in studying and research 16.

“The practical experiment about teaching method in chemistry” is an important subject, which is indispensable in training syllabus for pedagogic students in chemistry. Students can not only obtain the teaching of chemical experiment theory but also train abilities as analyzing purposes and significance of every chemical experiment in high school programs. Moreover, students can develop teaching methods and organization abilities; they can guide the learner in performing experiments. Therefore, using information technology with multimedia devices to design ebooks for this subject includes documents, experiment simulation, interaction test questions, … will be the tools to support for student to practise the experimental practical skills in teaching chemistry.

2. Designing Electronic Coursebook for Experimental Practical Methods in Teaching Chemistry

2.1. Softwares Design Electronic Coursebook

There are many design electronic coursebook softwares as Lectora, Moodle, eXe, Macromedia Dreamweaver … In our research, Macromedia Dreamweaver software was chosen because of their available functions such as insert flash, video, change theme following ideas, create hyperlink… 17.

To enhance interaction, we also used Macromedia Flash MX 2004 software to design the simulation 18, iSpring QuizMaker software to design the multiple-choice test 19.

2.2. Principles in Designing Electronic Coursebook

To design an electronic coursebook with high quality, the designing process must adhere to pedagogical principles. We built the principles for designing electronic coursebook as follow:

a) Guarantee the science

This principle requires that electronic coursebook’s contents are precise and modern. Experiment systems in electronic coursebooks are built with linking content of the subject “The Practical Experiment about Teaching Method in Chemistry”.

Moreover, electronic coursebook must be designed simply, consistently and easily to understand conveniently. The document, figure, simulation, video… in electronic coursebooks must be coherent with content and students’ level, attractive to use.

b) Guarantee the pedagogical

Designed electronic coursebook has to be logical and contain a clear lay out. It accommodates with student’s level, to help improve the creation in student’s awareness.

Virtual experiments must match the actual size with clear phenomenon and easy observation. Multiple-choice questions must be available in the experimental content to assess students’ learning outcomes.

c) Guarantee the usability

This is an important principle in designing electronic coursebooks. It guarantees to use at everywhere, anytime. Everyone can use widely, easily, available in normal computer in the long time with update ability.

Learners can interact with coursebooks, teachers and other students through e-learning system.

d) Guarantee the aesthetics

Designed electronic coursebooks that are harmonious, logically sized, clearly colored, and contain exact simulations about experiments and structures, in order to help students to understand and search the reference information easily.

2.2. Steps in Designing Electronic Coursebooks

It includes 6 steps as following:

Step 1: Analyzing situations to propose appropriate goals

Step 2: Determining the key and basic knowledge

Step 3: Building the teaching scenario

Step 4: Building the document system for electronic coursebook

Step 5: Choosing software that can perform easily the simulations and digitalizing electronic scenario

Step 6: Trial running, editing and completing the electronic coursebook.

3. The Content of Electronic Coursebooks for Experimental Practical Methods in Teaching Chemistry

The Electronic coursebook for the subject “Practical experiment about teaching method in chemistry” was designed with the below structure (see Figure 1).

Cover: Introduce electronic coursebook’s name, author’s preface.

Guide: Learner operates the functions and procedures to get efficiency.

Content: Electronic coursebook includes 10 subjects about experimental practical methods in teaching chemistry according to chemsitry textbook of grades 10, 11, 12 in Vietnam, splitting the experimental subject into many small knowledge modules. Scenarios’ main content of electronic coursebook includes (see Figure 2).

3.1. Name of the Topic of Experiment

Target of experimental subject: Determining the knowledge targets, skills, attitude and competence to propose appropriate content and test.

List of experiments: Determining list of experiments and rearranging in order (No. 1, No. 2, …) The experimental module includes the following knowledge:

Name of experiment.

Chemicals and tools: List all of chemicals and tools.

Experimental technique: How to conduct the experiment, how to assemble tools.

Note: List the notes for successful safety experiments.

Illustrated simulation: Simulation illustrates how to install the instruments (apparatuses), conducting experiments and phenomena occur.

Question: Based on the content of the experiment, multiple choice questions were designed in accordance with the content of the experiment and the level of awareness of the students. This system of questions is written by test software in the form of interaction with learners (https://www.ispringsolutions.com/ispring-quizmaker).

Test: Determining the knowledge system about chemical experimental skills obtained when students study experimental lessons. Forming multiple choice questions on computer software to consolidate and inculcate knowledge about chemical experimental skills for students.

Link to website: Introducing related websites for learners.

Funny chemical experiments: Introducing some funny experiments for learners. They can use for chemical extracurricular activities.

References: Supporting documents can be used.

Authors: Introducing electronic coursebook’s authors.

Knowledge modules in the Electronic Coursebook (see Figure 2 and Figure 3)

4. Using Electronic Coursebook to Develop Pedagogical Student’s Competence

Electronic coursebook is used in two forms: before or during doing experiments.

Form 1: Electronic coursebook is used before doing experiments.

In this form, electronic coursebook supports students in self-learning at home.

Basic knowledge about using laboratory apparatuses, common chemicals, some basic activities in the lab of chemistry teaching method.

Students can understand some experimental operations and skills in the chemistry programs of grades 10, 11, 12 in Vietnam.

Students can practice the experimental performance skills by experimental simulation. They can orient the ways to use experiments in chemistry program of grades 10, 11, 12 in Vietnam.

Using electronic coursebook before doing experiments can decrease the time to study the experimental procedure and can increase the time to practise experimental skills, and organize the experiment activities in high school. These activities can help to form experimental practical competence and organize teaching the experiments in chemistry.

Form 2: Electronic coursebook is used during doing experiments.

The using sequence of electronic coursebook in lessons as following:

Use multiple choice test (see Figure 4) to check the student’s preparation at home. The questions were designed in multiple-choice type with contents connected to the notes in safety, and the experimental skills to succeed.

Teachers use electronic coursebook to guide and emphasize the notes, using tools, chemicals, difficulties and experiences to have experimental success.

Students observe experimental simulations to get familiar with how to assemble the tools, operations in experiment.

Students carry out experiments in small groups.

Using electronic coursebook to check the experimental results through experiment simulations. Test the students’ obtained knowledge by multiple-choice test on computer designed by electronic coursebook.

Example: Teaching in halogen topic (in this example, we illustrate an experiment about preparing and collecting chlorine gas in lab).

Action 1: Lecturer opens electronic coursebook and introduces the list of experiments.

Action 2: Test the homework contents of students (see Figure 5).

Lecturer invites about 2 – 3 students to do the test with contents in electronic coursebook, to examine the skills of using experiment, the notes about skills for safe and success.

Lecturer comments the homework preparation of students.

Action 3: Lecturer guides to do the experiment and practise the experimental skills in electronic coursebook (see Figure 6).

Lecturer shows the experiment simulation to note the assembly of tools, experimental skill base on observed simulations.

Lecturer requests their students to discuss the notes when they do experiment successfully.

Lecturer notes the important contents in every experiment.

Chlorine is poisonous gas, we must conduct experiment in the laboratory fume hood, only prepare a little chlorine gas to use; have the knowledge about the poisoning prevention and can provide first aid to the poisoned person.

Action 4: Discuss about the using experiment in organizing to teach and learn chemistry in high school.

In experiments about halogen group, which experiment will be done in research method? which experiment to discover and to solve the problems? which experiment to check? To choose the experiment method, we need to explain the chosen reason and show the location of experiment in chemistry lesson.

Apply empirical knowledge to explain the situations in life.

Action 5: Students do experiment in small group; lecturer observes, guides, notes to safe successful experiment; lecturer chooses a random group to record video of the experiment operations.

Action 6: Test the students in knowledge related to experimental skills, lecturer uses the available test in electronic coursebook to test about 2 – 3 students (see Figure 7).

5. Data Collection and Analysis

To verify the valuation of electronic coursebook, we have collected the learners’ comments by survey. We obtained 102 survey questionnaires from third-year students of the courses in 2015 – 2016 and 2016 – 2017 at Dong Thap University, Vinh University, Hanoi University of Education in Vietnam. The obtained results presented in Table 1.

To assess the impact of the electronic coursebook on the development of student experimental competence, we used the table in observation by self-student. We have surveyed to students: testing before impacting and after impacting to only group. Designing for this study is as follows:

O1 ----------- X ------------ O2

O1 -------- Before Impacting (BI)

O2 -------- After Impacting (AI)

X --------- Using the electronic coursebook

Result will be evaluated by comparing the difference of average values of results before and after impacting. If O2 - O1> 0, X (impacting) has effect.

Before impacting: Organizing for students to make survey questionnaires about the experimental practical competence in chemistry before getting access to the electronic coursebook.

After impacting: The second servey, students evaluate developing their competences base on the criteria with 4 levels as the Table 2 and Table 3.

We used SPSS software to analysis experimental data, the obtained results confirm the impacting effects 20. The parameters are are represented in Table 4, Figure 8, and Table 5.

6. Results and Discussion

Results of survey the students’ awareness about efficiency in using electronic coursebook to develop the experimental competence in chemistry are illustrated in Table 1. The results show that the assessments about content, form, feasibility and efficiency have level 3 and level 4 with high rate. It was also found that the using electronic coursebook in organizing learning the module “The practical experiment about teaching method in chemistry” to help studens practise the experimental skills, decrease the preparation time before doing the experiment, good support for designing teaching plan and using experiment in teaching and learning chemistry. Students can self-test the knowledge related to experimental practical skills in chemistry.

The results in Table 4 and Table 5 show the homogeneity of average value Sig.(2-tailed) < 0.05 (Significant). The difference of the results before and after impacting is not random, it only happens when there is an impact (used the appropriate method). The difference average value and standard deviation is high, it demonstrates the effect of using the methods to form and develop experimental skills about chemistry for students is very big. The average mark after impacting is higher than the average mark before impacting with random occured probability < 5%. It confirms the procedure and developing method about experimental competence in chemistry for students is efficiency.

The pedagogic experimental results show that the using electronic coursebook to organize the teaching activities of experiment in teaching chemistry is very necessary to help students practice the experimental skills by experimental simulations and exercises in the electronic coursebook. By the simulations, students assemble the experimental apparatuses, observe the experimental phenomenon before coming into lab. Students can interact with experimental exercises’ system in the electronic coursebook with test software, it can help students to check the knowledge and skills in lab.

7. Conclusion

Electronic Coursebook for Experimental Practical Methods in Teaching Chemistry that integrated figures, simulated experiments, software to test knowledge, … is the document source to develop competences as the experimental practice skills in teaching chemistry, and self-study competence for students.

In terms of pedagogy, the electronic coursebook helps students prepare their chemistry lab assignments with notes about their experimental skills to ensure a successful experiment. Particularly useful for toxic experiments, expensive chemicals, too fast or too slow reactions, complex equipment, etc., are not suitable for conducting experiments in lesson.

The electronic coursebook can be used in two ways: using before experiment and using during experiment. Students can interact with simulation experiments, experimental exercises in the test software in the electronic coursebook. The experimental results of student’s awareness in contents and form are good, students are interested in learning with the electronic coursebook. Experimental results with 102 pedalogical students in chemistry in Vietnam have showed that, the average mark after impacting is higher the mark before impacting with random probability < 5 %. This shows the procedure and methods to develop the experimental practical competences for students in teaching chemistry are efficient. The electronic coursebook was built including 10 lessons, which integrate 100 experiments in chemistry program at grades 10, 11, 12 in Vietnam. This document is useful for lecturers and pedagogical students in chemistry.

Acknowledgements

We thank the anonymous reviewers of this paper for many very helpful suggestions.

Competing Financial Interests

The authors declare no competing financial interests.

References

[1]  Nor, H. I., Johari, S., Khew, P. H., & Safiah, Y. (2004). “Typical” teaching method applied in chemistry experiment. Procedia - Social and Behavioral Sciences 116, 4946-4954.
In article      
 
[2]  Brian, F. W., Heidi, R. C., Gregory, L. W., Melissa, S. M., Richard, S., Rob, A., & Greg, B. (2004). The Virtual ChemLab Project: A Realistic and Sophisticated Simulation of Inorganic Qualitative Analysis. Journal of Chemical Education, 81(11), 1672-1678.
In article      View Article
 
[3]  Jonathan, A. (2010). ICT transforming education-A Regional Guide, UNESCO Bangkok, Thailand.
In article      
 
[4]  Jehudit, J. D., Susan, R., & Saccha, S. (2013). How to promote chemistry learning through the use of ICT. Teaching chemistry-A studybook (pp. 213-240), Springer.
In article      
 
[5]  Barak, M., & Dori, Y. J. (2011). Science education in primary schools: Is an animation worth a thousand pictures?. Journal of Science Education and Technology, 20, 608-620.
In article      View Article
 
[6]  Chiu, J., & Linn, M. (2012). The Role of Self-monitoring in Learning Chemistry with Dynamic Visualizations. In A. Zohar & Y. J. Dori (eds.), Metacognition in science education, 133-163.
In article      View Article
 
[7]  Eilks, I., Witteck, T., & Pietzner, V. (2010). Using multimedia learning aids from the Internet for teaching chemistry. In S. Rodrigues (ed.). Multiple literacy and science education: ICTs in formal and informal learning environments, 49-69.
In article      View Article
 
[8]  Barnea, N., & Dori, Y. J. (1999). High-school chemistry students’ performance and gender differences in a computerized molecular modeling learning environment. Journal of Science Education and Technology, 8, 257-271.
In article      View Article
 
[9]  Dori, Y. J., & Kaberman, Z. (2012). Assessing high school chemistry students’ modeling sub-skills in a computerized molecular modeling learning environment. Instructional Science, 40, 69-91.
In article      View Article
 
[10]  Zacharia, Z. C. (2007). Comparing and combining real and virtual experimentation: An effort to enhance students’ conceptual understanding of electric circuits. Journal of Computer Assisted Learning, 23, 120-132.
In article      View Article
 
[11]  Karen Murcia, K. (2010). Multi-modal representations in primary science: What’s offered by interactive whiteboard technology? Teaching Science, 56, 23-29.
In article      
 
[12]  Climent-Bellido, M.S., Martínez-Jiménez, P., Pontes-Pedrajas A., & Polo, J. (2003). Learning in Chemistry with Virtual Laboratories. Journal of Chemical Education, 80(3), 346.
In article      View Article
 
[13]  Jens, J., & Agnieszka, K. K., (2006). Simulation of laboratory assignments to support students’ learning of introductory inorganic chemistry. Chemistry Education Research and Practice, 7(4), 266-279.
In article      View Article
 
[14]  Kurt, W., Matthew, S., & Deborah, W. (2014). A Study of High School Students’ Performance of a Chemistry Experiment within the Virtual World of Second Life. Journal of Chemical Education, 91(9), 1432-1438.
In article      View Article
 
[15]  Alyssa, C. H., Logan, M. N., & Paul, A. S. (2016). Student-Led Development of an Interactive and Free Biochemical Methods eBook. Journal of Chemical Education, 93(6), 1034-1038.
In article      View Article
 
[16]  Koos, V. D. K., Gerrit, B., Rob, H., & Harry, G. (2012). Students Using a Novel Web-Based Laboratory Class Support System: A Case Study in Food Chemistry Education. Journal of Chemical Education, 89(1), 103-108.
In article      View Article
 
[17]  Khristine, A. P. (2006). Macromedia Dreamweaver 8: Training from the Source. https://www.tsamem-web.com/macromedia-dreamweaver-8-training-from-the-source-english.pdf. Macromedia Press.
In article      View Article
 
[18]  Craig, M., Justin, E. (2003). Macromedia Flash MX 2004 Game Programming [Computer software]. Muska & Lipman/Premier-Trade.
In article      
 
[19]  https://www.ispringsolutions.com/ispring-quizmaker.
In article      View Article
 
[20]  Howitt, D., & Cramer, D. (2000). A guide to computing statistics with SPSS for Windows (Version 10). London, UK: Prentice Hall.
In article      
 

Published with license by Science and Education Publishing, Copyright © 2018 Cao Cu Giac and Ly Huy Hoang

Creative CommonsThis work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit https://creativecommons.org/licenses/by/4.0/

Cite this article:

Normal Style
Cao Cu Giac, Ly Huy Hoang. Designing and Testing Electronic Coursebook to Develop Student's Competence in Experimental Practical Methods in Teaching Chemistry at the Universities of Education in Vietnam. World Journal of Chemical Education. Vol. 6, No. 4, 2018, pp 145-153. https://pubs.sciepub.com/wjce/6/4/1
MLA Style
Giac, Cao Cu, and Ly Huy Hoang. "Designing and Testing Electronic Coursebook to Develop Student's Competence in Experimental Practical Methods in Teaching Chemistry at the Universities of Education in Vietnam." World Journal of Chemical Education 6.4 (2018): 145-153.
APA Style
Giac, C. C. , & Hoang, L. H. (2018). Designing and Testing Electronic Coursebook to Develop Student's Competence in Experimental Practical Methods in Teaching Chemistry at the Universities of Education in Vietnam. World Journal of Chemical Education, 6(4), 145-153.
Chicago Style
Giac, Cao Cu, and Ly Huy Hoang. "Designing and Testing Electronic Coursebook to Develop Student's Competence in Experimental Practical Methods in Teaching Chemistry at the Universities of Education in Vietnam." World Journal of Chemical Education 6, no. 4 (2018): 145-153.
Share
  • Table 2. Survey results before and after impacting to experiment practice competences about chemistry (N = 102).
  • Table 4. Values of the measurement before and after impacting of 102 participants (pedagogical students in chemistry) in Vietnam
[1]  Nor, H. I., Johari, S., Khew, P. H., & Safiah, Y. (2004). “Typical” teaching method applied in chemistry experiment. Procedia - Social and Behavioral Sciences 116, 4946-4954.
In article      
 
[2]  Brian, F. W., Heidi, R. C., Gregory, L. W., Melissa, S. M., Richard, S., Rob, A., & Greg, B. (2004). The Virtual ChemLab Project: A Realistic and Sophisticated Simulation of Inorganic Qualitative Analysis. Journal of Chemical Education, 81(11), 1672-1678.
In article      View Article
 
[3]  Jonathan, A. (2010). ICT transforming education-A Regional Guide, UNESCO Bangkok, Thailand.
In article      
 
[4]  Jehudit, J. D., Susan, R., & Saccha, S. (2013). How to promote chemistry learning through the use of ICT. Teaching chemistry-A studybook (pp. 213-240), Springer.
In article      
 
[5]  Barak, M., & Dori, Y. J. (2011). Science education in primary schools: Is an animation worth a thousand pictures?. Journal of Science Education and Technology, 20, 608-620.
In article      View Article
 
[6]  Chiu, J., & Linn, M. (2012). The Role of Self-monitoring in Learning Chemistry with Dynamic Visualizations. In A. Zohar & Y. J. Dori (eds.), Metacognition in science education, 133-163.
In article      View Article
 
[7]  Eilks, I., Witteck, T., & Pietzner, V. (2010). Using multimedia learning aids from the Internet for teaching chemistry. In S. Rodrigues (ed.). Multiple literacy and science education: ICTs in formal and informal learning environments, 49-69.
In article      View Article
 
[8]  Barnea, N., & Dori, Y. J. (1999). High-school chemistry students’ performance and gender differences in a computerized molecular modeling learning environment. Journal of Science Education and Technology, 8, 257-271.
In article      View Article
 
[9]  Dori, Y. J., & Kaberman, Z. (2012). Assessing high school chemistry students’ modeling sub-skills in a computerized molecular modeling learning environment. Instructional Science, 40, 69-91.
In article      View Article
 
[10]  Zacharia, Z. C. (2007). Comparing and combining real and virtual experimentation: An effort to enhance students’ conceptual understanding of electric circuits. Journal of Computer Assisted Learning, 23, 120-132.
In article      View Article
 
[11]  Karen Murcia, K. (2010). Multi-modal representations in primary science: What’s offered by interactive whiteboard technology? Teaching Science, 56, 23-29.
In article      
 
[12]  Climent-Bellido, M.S., Martínez-Jiménez, P., Pontes-Pedrajas A., & Polo, J. (2003). Learning in Chemistry with Virtual Laboratories. Journal of Chemical Education, 80(3), 346.
In article      View Article
 
[13]  Jens, J., & Agnieszka, K. K., (2006). Simulation of laboratory assignments to support students’ learning of introductory inorganic chemistry. Chemistry Education Research and Practice, 7(4), 266-279.
In article      View Article
 
[14]  Kurt, W., Matthew, S., & Deborah, W. (2014). A Study of High School Students’ Performance of a Chemistry Experiment within the Virtual World of Second Life. Journal of Chemical Education, 91(9), 1432-1438.
In article      View Article
 
[15]  Alyssa, C. H., Logan, M. N., & Paul, A. S. (2016). Student-Led Development of an Interactive and Free Biochemical Methods eBook. Journal of Chemical Education, 93(6), 1034-1038.
In article      View Article
 
[16]  Koos, V. D. K., Gerrit, B., Rob, H., & Harry, G. (2012). Students Using a Novel Web-Based Laboratory Class Support System: A Case Study in Food Chemistry Education. Journal of Chemical Education, 89(1), 103-108.
In article      View Article
 
[17]  Khristine, A. P. (2006). Macromedia Dreamweaver 8: Training from the Source. https://www.tsamem-web.com/macromedia-dreamweaver-8-training-from-the-source-english.pdf. Macromedia Press.
In article      View Article
 
[18]  Craig, M., Justin, E. (2003). Macromedia Flash MX 2004 Game Programming [Computer software]. Muska & Lipman/Premier-Trade.
In article      
 
[19]  https://www.ispringsolutions.com/ispring-quizmaker.
In article      View Article
 
[20]  Howitt, D., & Cramer, D. (2000). A guide to computing statistics with SPSS for Windows (Version 10). London, UK: Prentice Hall.
In article