1. Introduction

At present, by placing higher education institution at the center, “blended learning” is being implemented for the sake of making classes more effective, efficient and attractive ^{[1, 3]}. It has been reported that implementation method of "Blended Learning” is incorporated for the training sessions in the corporate world ^[2]. The author is moving forward with university education that will nurture problem solving ability with incorporation of making things by hand and rating activities ^[5]. As the support for the lecture, a proposal has been made to increase study opportunities for various students, and to able to correspond to individual students so that they can prepare/review at “anytime and anywhere” ^[3].

As a part of such proposal, the author conducted a “blended class” that combined to take a lecture, to use lecture sorting notes distributed, to have mini tests, and to learn by e-learning (learning based on lecture slides and exercise problems, mutual learning and rating of materials drawn up by students) ^[7]. After conducting a survey analysis on lecture method, change in awareness, term recognition, useful activities etc., the author made a report which concluded such activities to be effective ^{[8, 10, 12, 13, 17]}.

On the basis of these outcomes, by targeting elementary school, middle school, high school, university, professional school, corporations, etc., a book on “blended learning” called “From e-learning to blended learning” was edited and published through gathering the procedure of efficient, effective, and attractive blended class, and the effect of practice in such class ^[7]. We compared utilized media and change of awareness related to ability among 10 blended classes ^[25]. It reported that with respect to all of the subjects including general awareness and awareness related to subjects, significant improvement is shown on average rating score for all of awareness items.

In this paper, by using information related to awareness, 10 subjects that were set up as a class design and were put into practice will be categorized into 3 class type groups. We will identify the characteristic of class type group of categorized subjects by using the awareness elongation, utilized media and required time for such media.

2. Research Purpose

In order to find out the kind of difference concerning the effect of utilized media and its implementation method that exist among the subject of blended class implemented at information related department in University A, we will compare class method, utilized media, the result of awareness survey conducted before/afterwards, and activities that are useful for awareness improvement that was surveyed afterwards. We will identify the kind of difference that exists between the learning effect of each type when categorizing subjects into lecture type class, exercise type class, and experiment type class.

3. Class Type

The class will be generally divided into lecture type class, exercise type class, and experiment type class. The lecture type class is held in a class room setting where an instructor faces the students, and since such class is often held by partially combining exercise, etc., it is regarded as a lesson form with emphasis on assembly style learning.

The exercise type class is a type of class which enables students to gain deeper understanding on their learned materials by first making them solve problems/topics and afterwards provide them with answers and commentary for such materials. It is a lesson form that combines individual learning as main and assembly style learning as secondary.

The goal of information science related experiment type class is to verify the theory and basic principle of information science, to promote permanent understanding of knowledge, to master basic operational skill of experiment, and to nurture strict and steady work attitude. It is a lesson form that experientially enables students to learn basic programming, algorithm, and computer operation skill through actually operating the computer. This is a lesson form with emphasis on individual learning with eventual submission of report.

4. Comparison Method

When making general division of surveyed question items, they are divided into general awareness and awareness related to subject. As the example of rating items of awareness survey that was conducted, rating items of Subject G are shown on Table 1. At the beginning and end of the class for each subject, we have asked students to respond to the rating item of Table 1. Through significant test, we will compare just what kind of difference exists between the changes in general awareness that students have responded. We will also compare to see if there is difference between the numbers of activities that are useful in improving awareness through significant test.

By using 4 types of data that are related to awareness, we will obtain the principal component score and will compare 10 subjects by using the score. We will separate utilized media into 5 levels based on its frequent use. We will conduct principal component analysis by using its levels. Next, we will conduct the principal component analysis by using awareness

In addition, we will conduct the principal component analysis by using the activity time of 8 types of media for each subject. Three kinds of principal component scores will be obtained. Finally, we will make a comparison of 10 subjects by using three types of the principal component scores.

By obtaining the correlation coefficient of the principal component scores of these 3 types, we will compare the characteristics of the class type group.

Table 1. Example of rating items of awareness survey for Subject G

Download as

PowerPoint Slide

Larger image(png format)

• Tables index

Veiw figure

View current table in a new window

View next table

5. Utilized Media of Subjects

We will make a comparison on media that was utilized for 10 subjects of information related course at University A. Lecture type classes are 5 subjects of A to E subjects, exercise type classes are 3 subjects of F to H subjects, and experiment type class are 2 subjects consisting of subject I and J.

Table 2. Media used in each subject

Download as

PowerPoint Slide

Larger image(png format)

• Tables index

Veiw figure

View current table in a new window

View previous table

View next table

We have categorized the frequency of media utilized during class or outside of class into 5 levels and show it on Table 2. The 5 levels 4, 3, 2, 1 and 0 on Table 2 show that each of them is “almost used every week”, “used 4 to 5 times that amounts to roughly 1/3”, “used twice”, “used once”, and “no use” respectively.

6. Typical Class Development of Each Class Type

Class methods, change of term recognition and change of the attitude have been already reported for eight of ten subjects analyzed. Contents of subject A, C, E, F, G, H, I, and J are reported in papers (^{[4, 6]}), (^{[13, 17]}), (^{[11, 14, 15]}), (^{[16, 19]}), (^{[20, 21, 23]}), (^{[18, 22, 24]}), ^[5], and ^[12] respectively. In the following, a class development example of one subject is explained in each class type.

The class subject that was the target of our research was an Introduction to Computer in the first semester of the first year in the Department of Information Science at a university. The class was conducted 15 times with each class being 90 minutes long. A midterm and a final examination were conducted in the 7th and 15th week in order to motivate learning and confirm the understanding.

The outside the classroom blended class will be explained in the following ^{[4, 6]}. 89 students participated. We distributed a structured notebook which consists of about 100 questions within 26 pages. Students were recommended to use it for preparation and review. Students were given a lecture by projecting slides onto a screen in the classroom for about 80 minutes. A small test which consists of 2 to 5 questions was conducted while allowing the students to see a textbook for about 10 minutes at the end of the class. The questions asked about points from the lecture.

Students were required to bring the structured notebook each time they come to class. They write answers in it to establish the class's contents. A teacher went around the desks while the students were writing and responded to their questions. In some cases a method of thinking for how to solve problems were explained on the blackboard.

E-learning has functions of learning via lecture slides and exercises. This can be used for preparation and review before and after a class. As Introduction to Computer is a special subject and involves a lot of technical terms, there are a lot of students who find it difficult to understand the contents in only one lecture. At the students' convenience, lecture slides can be repeatedly seen as many times as necessary to improve their understanding. Individual learning is conducted by using such e-learning methods. Students were required to solve problems using e-learning mainly in the classes one week prior to having examinations in order to encourage learning through problem solving. It is our goal that all the students acquire subject content by such means.

A student was required to make learning material for explaining technical terms in a few pages which is a part of subject contents in order to utilize the knowledge learned concerning the subject contents at the end of the course. Document including an example of the learning material was distributed and how to make it was explained. The report sheets were registered after submission. Students saw and rated them mutually. Then, they corrected and improved the learning material by referring to the evaluations and teacher's advice. We hope that the activities further deepen the understanding and broaden the lecture contents. These activities encouraged interaction among the students.

After completing the e-learning, students were required to input their learning situation, evaluation value of the learning contents, and degrees of abilities and attitude into an evaluation sheet, and submit the file. We told the students to include all submission materials in their personal records to create motivation for learning.

Content of subject H is Operations Research (OR) and exercise type class. OR is a mathematical model for decision-making. Many mathematical models are proposed. The goal of this class is to explain these techniques, to actually practice these techniques after the lecture, to cultivate understanding and to be useful in problem solving in society ^{[22, 24]}. In addition, through various activities in these lectures, the ability to think and solve problems is cultivated.

The aims of this class are to understand the selected mathematical models in OR and the algorithms of these techniques so that students can solve the problems according to these algorithms.

In the first week, class plan explanations were distributed and class planning was explained. After that, an initial survey of term recognition and awareness was conducted. Based on the textbook, the goals, problem definition and solution method for the example were explained for Chapter 4 Transportation. Next, practice sheets were distributed and students were asked to solve the practice problems referring to the explanation of the solution method for the example. At that time, students were given advice to browse the e-learning lecture slides and refer to them. During practice, the teacher went around the classroom and accepted a question. Students were observed helping each other. Those who came up with the answers were asked to submit their practice sheets. Those who did not come up with the answers were asked to bring their completed practice sheets to the teacher’s office before the next class.

The next week, the answers to the practice problems were given. After that, sheets were handed back to those who had made mistakes in the answers or the calculations. Next, challenge sheets were distributed and students were asked to solve the problems. At that time, the students were advised to browse the e-learning lecture slides and refer to them. Those who came up with the answers were asked to submit their challenge sheets. Those who did not come up with the answers during class were asked to bring their completed challenge sheets to the professor’s office by the next class.

In the 3rd week, the goals, problem definition and solution method for the example were explained for Chapter 5 Allocation. Next, the students were asked to solve practice problems in the same way as for Chapter 4 and submit them. In the 4th week, the students were asked to solve challenge problems in the same way as for Chapter 4 and submit them. In this way, the class got through one chapter every 2 weeks.

The submission of practice and challenge problems was repeated until the answer was correct. If a problem sheet was to be given back, mistakes on the sheet were marked with a colored pencil. There were some students who took a long time to get the right answers even though they were able to browse e-learning documents after the answers were explained in class. In the end, 7 practice and challenge problems were completed in 15 weeks. Post surveys of term recognition and awareness were taken in the 15th week.

Students were asked to fill in the goals, problem definition and discussion for each chapter after downloading framework files and were asked to submit these two reports in the 8th and the 14th weeks.

The target subject is called an information science experiment, consisting of three hours per week as one of the compulsory subjects in the second semester at the department of information science in a university. The content which the author was in charge of was “creating digital storytelling” ^[12]. Students are separated into three groups. Each group creates the storytelling for four weeks. Each class session was 180 minutes long, and the class proceeded according to the plan. The themes of each group are different as follows; three theme are "self-understanding", "a children's story", and "a future course". Each group carried out the class by four weeks. The first, second and third groups created each theme of storytelling from 1 to 4, from 5 to 8, and from 9 to 12 weeks respectively. The class was conducted by a teacher and a teaching assistant. After explaining the activity contents of the day at the beginning of each class, the teachers walked around the classroom and responded to questions as needed. The number of students attending a lesson was 63 persons in total. These of three groups are 21, 22 and 20 persons respectively.

One of the purposes of this class is to heighten students' literacy in computer and self-expression through creative activities. The literacy in computer means that the PC can be smoothly operated using functions of Word, Excel, PowerPoint and so on.

Self-understanding and self-analysis are important when searching for jobs. Another purpose is to deepen self-understanding and a meaning to work through creating a storytelling on the assigned theme.

The teacher gathered together three groups for a class some days ago. Then he distributed an experiment description document (A4 paper, 31 pages) to the students and explained the outline of class method. Based on the experiment description document, the teacher explained the experiment’s purpose, contents, plan, slide creation method, experimental method, and related details. He distributed one A4 sheet to the students. Six pictures and the narrative stories could be entered using both sides of the sheet. Students were assigned to write a story on the right-hand page and to draw a related picture within the square frame on the left-hand page before the first session. The illustration and character for an animation are drawn outside of the square frame. The students were instructed to paint handwritten picture with colored pencils.

The students were instructed to download the story slide of the “My course in the future” as an example for their assignment.

The teacher explained how to animate slides in the first session. They subsequently scanned the images of their sheet with an image scanner. Then they imported the images to Paint software, which were installed as part of Windows XP Microsoft suite of files. The students cut the images on Paint software and pasted them on slides with PowerPoint. The teacher instructed a student who completes the work and has room at time so as to attach an animation using a function of PowerPoint.

At the beginning of the second session, the teacher explained how to write reports. They were required to enter the final image works into PowerPoint to create their slides. They attached an animation to illustrations and characters for deeper understanding for their stories. Students then recorded their storytelling narrations using a microphone while viewing their slide show after their works were completed. At the end of the second session, the students required to submit the file of the storytelling slide. Students themselves rated their works on an evaluation sheet after completing the works.

At the start of the third session, the teacher printed and distributed a peer evaluation sheet and a handout in which all works by the students were printed. The slide shows of all members in the class were sequentially projected on the screen and viewed. Then they were required to evaluate them for one minute. After the students evaluated each story, the evaluations were entered into the peer evaluation sheet. After viewing all the story slide shows, the students entered the rating value and comment to spreadsheet in Excel, and the files were submitted using the Internet. The teacher gathered and summarized the evaluations in each student’s file, then gave each student access to an e-learning portal so that they could download the peer evaluations. The teacher also pointed out the points that should be revised in the printed work and distributed instructor feedback to each student. The students were then required to modify their digital stories and slides by referring to the peer evaluations and the instructor feedback provided. Students performed the second self-assessments after modification in the third session. After the correction, they submitted the file of the story slide.

The modified story slides were viewed again in the same manner as during the third session, and then evaluated once again in the fourth session. The second peer evaluation was entered into an assessment spreadsheet, and the files were also submitted.

The teacher gathered and summarized the evaluations in each student’s file, then gave each student access to an e-learning portal in the same manner as in the third session. Students then pasted the second peer assessment for themselves on an assessment spreadsheet. By comparing the first and second evaluations, students could learn from and interpret the appropriateness of the corrected elements. Students performed the third self-assessments after the final evaluation in the fourth session.

The report was divided it into three times. Students were asked to submit reports on previous day of the third, fourth and fifth session. The submitted report was pointed out a correction point and returned on the next day.

7. Analysis Result and Observation

To find out about modification in awareness, ability related awareness survey was conducted through the holding of information related class session. Concerning the ability and awareness that showed signs of improvement due to class session, 2 surveys were taken, once before and once after the class attendance. The rating score for such survey was divided into the following 9 levels: (1. Non-existence, 3. Very small existence, 5. Small existence, 7. Large existence, and 9. Very large existence). The result will be explained by analyzing such survey data of 10 subjects through significant test.

The number of students who submitted both before/after survey of 10 subjects is between 18 and 79 people as shown on Table 3. With respect to the general awareness of 30 items, we have conducted a “t test” that corresponded to difference between rating score before and after survey in rating item shown on Table 1 of each subject’s ability and awareness survey. “t-test” results for individual subject are shown on Table 3. The row of Table 3 consists of class type, subject name, number of rating items, number of respondents, number of items that had significant difference, number of items that had tendency for significant difference, ratio (%) of items recognized for significant difference, ratio (%) of items with tendency for significant difference, average of difference in rating score. The classification of the subject in Table 3 is based on the result in Section 7.3. The column consists of 5 subjects A to D and G of lecture type, 2 subjects F and H of exercise type, and 3 subjects E, I and J of experiment type.

Table 3. Comparison of the results of significant difference test for awareness related to ability

Download as

PowerPoint Slide

Larger image(png format)

• Tables index

Veiw figure

View current table in a new window

View previous table

View next table

In Table 3, the average ratio of the number of rating items recognized for significant difference were approximately 58%, and the average rate of the number of items with tendency toward significant difference were approximately 4%. Based on this, an increase in ability and awareness on approximately 58% of the items is recognized.

For the exercise type class, the average ratio of the number of rating items recognized for significant difference between pre and post rating score of ability and awareness was approximately 41%, while the average rate of the number of items with tendency toward significant difference was 13%. Based on this, an increase in ability and awareness on approximately 41% of the items is recognized.

Significant difference has been recognized for all 30 rating items for the experiment type class. Based on this, an increase in ability and awareness on all of the items, in other words 100% of the items is recognized.

As the result of conducting significant test on general awareness, it divided into subjects that showed significant increase for over 70% of items within lecture type and exercise type, and subjects with significant increase for less than 43% of items. By corresponding to such separation, 10 subjects are divided into large subject and small subject for the elongation of awareness.

On the other hand, 6 subjects were surveyed for awareness related to subjects. All such subjects showed increase in more than 72% of the items. General awareness has significantly increased for every subject, and awareness related to subject has also shown significant increase.

For each subject, we will use 124 (=4 x 31) information about each average rating score and overall average rating score for pre and post of 30 items of ability and awareness survey, average elongation of 31 items, and average number of activities useful for improvement of 31 awareness items. For the following, 124 information is called “4 types of data”.

In order to identify what kind of characteristics are found in individual subject group, principal component analysis was conducted through the use of variance-covariance matrix method. The factor loadings for principal component 1 and 2 were 51.5% and 22.5%, respectively. The cumulative factor loadings for such principal components were 73.9%. The items that showed large amount of principal component 1 were average elongation of 30 items, average post- rating score of 7 items, and the number of activities of 7 items. Based on this, component 1 is called “rating score related to average elongation”. The items with large principal component 2 were prior average rating score of 12 items and average number of activities of one item. Most of these scores were positive coefficients. Based on these findings, it is called “rating score related to pre survey” for question items. With respect to 124 information of the rating scores and average number of activities, we believe they can mostly be explained by these 2 principal components.

When looking at component matrix obtained from principal component analysis, the coefficient is negative for prior average rating score, and positive for post-average rating score, average elongation and average number of activities. Since the principal component gets larger as elongation and the number of activities gets larger, we believe that principal component score shows the learning effect. The principal component score is shown at lower end of Table 3. Based on this principal component score, we can see that subject with high learning effect is in order of subject I, J, E and so on. Furthermore, we were able to understand that subject with high learning effect is mostly in order of experimental type, exercise type, and lecture type class.

By performing cluster analysis as a variable on principal component 1 and 2 obtained from section 7.2 concerning 4 types of data related to awareness, we have categorized 10 subjects that are object of analysis into 3 clusters (groups). Three groups are shown on Fig.1 by using score of principal component 1 and 2.

Subject (circular seal) belonging to group 1 (G1) is shown as 5 subjects shown on bottom left corner. Post-average rating score, average elongation, and the number of activities for all items are lowest among 3 groups. 5 subjects which are (Introduction to computer science), B (Basic information technology II), C (Computer history), D (Introduction to e-learning), and G (Web programing I) are named “lecture type class” group. For Subject G, by roughly using up 2/3 of the class time, grammatical matters and program examples corresponding to that day are explained, along with explaining the exercise program. After such explanation, by referring to exercise program through roughly 1/3 of the class time, the students were asked to create and submit the program for exercise problems. Since this subject is exercise-centered subject and therefore was categorized as exercise type, the student’s respond for awareness showed that it belonged to lecture type. The reason may be that the number of activities shown on Table 3 is less than other 2 exercise type subjects and that it looks similar to lecture type subject.

Group 2 (G2, triangular seal) is shown as 2 subjects on top left. Among 3 groups, the average prior rating score and the number of activities for all items are shown to be highest. The post-rating score is higher of the three groups. This group showed small amount of increase with showing of average elongation being smaller than the overall average. Since the subjects of this group are 2 subjects which are F and H, they will be named “exercise type class”.

Group 3 (G3, quadrangular seal) is shown as 3 subjects on the right. The post-average rating score and average elongation scored the highest. The average number of activities is the second most among subject groups. Since the subjects of this group are classified as E, I, and J, this group is named “experiment type class”. For subject E, lecture were explained for 3 sessions. For the following one session, an exercise in drawing up learning guidance plan which is the purpose of the lecture, was conducted at personal computer room. We have implemented 12 sessions by repeating this kind of cycle for 3 times per every 4 sessions of class development. Afterwards, students were assigned to make presentation on their carefully produced learning guidance plan, and were assigned to make peer assessment and to draw-up report. Since this subject is lecture-centered subject, therefore it was categorized as lecture type at the beginning. But on contrary, student’s respond for awareness showed that it belonged to experiment type. The reason for such response may be that it looks similar to the original 2 subjects that were categorized as experiment type, since as shown on Table 3, and the prior rating score looks similar to the original experiment type of 2 subjects, along with average elongation being larger than other lecture type subjects.

Four types of data for each group (prior/post rating score of awareness, average elongation, and the number of activities) are shown on Table 4, where m and SD mean average and standard deviation, respectively. The variance analysis result is shown on Table 5 concerning these four types of data between groups, where SS, df, MS, F, and p mean sum of squares, degree of freedom, mean square, F value, and p value, respectively. Based on this, in regards to average elongation, the effect of condition showed significance (F (2,297) =180.4, p<.001). We therefore conducted a multiple comparison through Tukey method. The result is shown on far right of Table 5. Significant difference was found between groups G1 and G3 and between groups G2 and G3 for the average elongation. No significant difference was found between group G1 and G2. Based on this, we were able to understand that awareness of group G3 “experiment type class” has larger elongation than G2 “experiment type class” and G1 “lecture type class”.

Table 4. Comparison between rating value of pre and post attitude, average elongation, and the number of activities for each group

Download as

PowerPoint Slide

Larger image(png format)

• Tables index

Veiw figure

View current table in a new window

View previous table

View next table

Table 5. Results of analysis of variance and multiple comparison on the average elongation of attitude for each group

Download as

PowerPoint Slide

Larger image(png format)

• Tables index

Veiw figure

View current table in a new window

View previous table

View next table

The effect of condition for average number of activities showed significance (F (2,297) =166.6, p<.001). We therefore conducted a multiple comparison through Tukey method. The result showed that no significant difference was found between the number of activities for group G3 and G2. Significant difference was found between the numbers of activities for groups G3 and G1. Based on this, we were able to understand that the number of activities of G3 “experiment type class” and G2 “exercise type class” are larger than G1 “lecture type class”.

Download as

• PPT
  PowerPoint Slide
• PNG
  Larger image(png format)

Veiw figureFigures index

•  NEW
  View larger figure in new window

Figure 1. Subject group classified by cluster analysis

We conducted discriminant analysis for 3 types of classes obtained in section 7.3 by doing cluster analysis for 124 average values of 4 types of data by combining rating score of prior/post awareness, its elongation, and the number of activities. Items with average for 4 types of data being larger than the total average are the important item for the group. Based on this, the important items for each group are as follows. The important items for lecture type group G1 are the19 items of prior rating score. We can therefore identify that for group G1, more than half of prior rating score are considered important. It means that group G1 is a subject group that these items are large.

The important items for exercise type group G2 are item 29 in prior rating score, 26 items in post rating score, 2 items in average elongation, and 29 items in the number of activities. We can therefore see that for group G2, almost all of prior rating value, post rating value, and the number of activities are considered important. It means that group G2 is a subject group that these items are large.

The important items for experimental type group G3 are all 31 items of post rating score, elongation and the number of activities. Based on this, the rating score of awareness for group G3 showed more increase in the post than group G1 and G2. It is also considered that listed number of activities for group G3 is more.

From such findings, we are able to understand that awareness is increased in the order of group “experiment type class G3”, “exercise type class G2”, and “lecture type class G1.” This finding leads to the same order as commonly shared idea and image for the improvement of motivation.

Using the 5 levels on frequency for utilized media in Table 2, principal component analysis were conducted based on covariance matrix. The factor loadings of principal component 1 and 2 were 40.3% and 20.2%, respectively. The cumulative factor loadings for such components came out to be 60.6%.

As a result, the factor loadings of component were positive large values for small test answers, small test, notebook to arrange lecture contents, browsing of small test answer, etc. They were negative large values for PC, document which explains, experiment book, peer evaluation, exercise program and problems, etc. Therefore, it was found that the principal component represents an indication on the frequency of utilized media required for the lecture.

The principal component scores obtained by the principal component analysis using the 5 levels on frequency for utilized media are shown in the bottom of Table 2. As a result, the principal component scores for subjects of lecture type are positive larger values all in all and the scores for subjects of the experiment type was found to be negative greater values all in all.

Small test, the answer, notebook to arrange lecture contents, textbooks, etc. are more frequently used, the larger the principal component scores based on frequency for utilized media become in the positive direction. Experiment book, PC, peer evaluation on work are more frequently used, the higher the principal component scores become in the negative direction.

The average time required for each activity in during class for each subject is shown in Table 6. The time required for the activities that was performed in class of 15 times is converted in terms of class of the 90 minutes. Therefore, the total of the average time for each subject is 90 minutes.

In most subjects of groups of "lecture type class G1", it takes more than half of time for lecture. The rest time is used in order to perform the exercise and small test. However, in subject G it takes more than half of time to exercise, as it was first classified into exercise type.

In the "exercise type class G2", it takes more than half of time to explain the answer of exercises or problems. Some lectures are also conducted.

In the "experiment type class G3", it takes more than half of time to create the work. The rest time is used to do lecture, to evaluate the work, and to create the report. However, in subjects E, as it was first classified into lecture type, it takes more than half of time to do lecture.

Principal component scores obtained by the principal component analysis using the average time in Table 6 are shown in the bottom of Table 6. The longer the time to actually address on making things such as the creation of work and solving problems, the larger this principal component score becomes in the negative direction. The longer the time for lecture, the larger it becomes in the positive direction. Therefore, it was found that the principal component score represents an indication on the length of time for making things and experiential activities.

As mentioned in Section 7.2, the principal component scores obtained by the principal component analysis using average of pre and post rating values of survey for awareness related to ability, the average elongation, and average No. of activities shown on the lower end of Table 3 represent the learning effect (improvement of awareness). Correlation coefficient r between the two principal component scores representing the time for these experiential activities and the learning effect is r = -0.84 **. It is recognized that the coefficient means significant strong correlation. It is found that longer experiential activity time means larger improvement of awareness.

Correlation coefficient between the two principal component scores of the frequency for utilized media and the time required to activity in class is r = 0.81 **. It is recognized that the coefficient means significant strong correlation. It is found that the higher frequency of use media means longer time required to activity.

Table 6. Average time for each activities required for each subject

Download as

PowerPoint Slide

Larger image(png format)

• Tables index

Veiw figure

View current table in a new window

View previous table

8. Discussion

Through conducting of cluster analysis by viewing principal component 1 and 2 obtained in Section 7.2 concerning 4 types of data which is 124 values of rating score for awareness, elongation, and the number of activities as variable, we have categorized 10 subjects that are object of analysis into 3 groups. As such result, the subjects that turned out to be different from the first category were subject E and subject G. Subject E viewed as a lecture type class was categorized into experiment type group. Subject G viewed as an exercise type was categorized into lecture type group.

The average required time per activities during each subject’s class session is shown on Table 6. The average required time was obtained by converting the required time for activities implemented throughout 15 class sessions into 90 minute single class session. Based on this, the total of average required time for each subject is regarded as 90 minutes.

For most of group “lecture type class G1”, more than half of average required time is used for lecture, and the remaining time is used to implement exercise and mini tests. However, when looking at subject G, over half of the time is used for exercise just as it was initially categorized under the exercise type.

For “exercise type class G2”, over half of the time is used to exercise or to explain answers of problems. Partial lecture is also conducted for this class.

For “experiment type class G3”, over half of the time is used for work creation, and the remaining time is used for lecture, rating activity of work, and drawing up report. However, for subject E, just as its initial categorization into lecture type, over half of the time is used for lecture.

The principal component score obtained from principal component analysis through the use of average required time is to be shown on bottom edge of Table 6. When time engaged in actually making something such as work creation and problem solving becomes long, the tendency of such principal component score seems to enlarge toward negative direction, and seems to enlarge toward positive direction when there is long lecture time. Based on such observation, we are able to understand that it revealed the index for the length of time being used for work creation and experience oriented activities.

As mentioned in Section 7.2, we were able to understand that the principal component score obtained through principal component analysis that uses 4 types of data listed under bottom edge of Table 3 shows the effect of learning (increase in awareness). The correlation coefficient between two principal component scores that shows such experience oriented activity time and effect of learning came out to be r＝-0.84. It is recognized to have strong correlation for its significance. Such finding shows that as the experience oriented activity time becomes longer, so does the improvement in awareness.

As you can see, the finding shows that the average required time for implemented activities causes great influence on awareness improvement. In specifics, it shows that having students engage in actual making of object such as work creation and having them solve problems are proving to be effective for awareness improvement. However, only activities during class session are not the contributing factor for the awareness improvement. Because “class” is generally composed by activities that are “in-class” and “outside of class”. Out of target subjects, students neither engage in work creation nor problem solving during class session which are subject A, B, C, and D. Such subjects are carefully arranged so that “in-class” activities can be supplemented by reviewing and evaluating them among each other “outside of class” through draw-up of reports and registering them on LMS. Such report include draw-up of document that explains terms brought up during lecture by looking them up outside of the class, report that introduces historical figures, or report on designing a class that uses e-learning. Through these activities, increase in awareness is recognized in all subjects.

The principal component analysis was conducted by using the 5 levels of the usage frequency of media. However, the analysis was conducted by excluding “lecture by slide, level of term recognition survey form, awareness survey form, lecture plan and method explanation form, learning through lecture slide, rating sheet, question mail, and notice board” that are used at same degree for all of the subjects. Obtained principal component score is shown on bottom edge of Table 2. Media with large and positive principal component 1 were mini test, lecture sorting note, text book, and exercise problem form. Media with large and negative and large items were PC, experiment form, peer assessment of work, and manual.

The finding suggests that as mini test, lecture sorting note, text book, exercise problem form, etc., which are characteristically utilized in lecture, are used more, the principal component score for utilized media also tends to get larger. The finding suggests that as the unique media utilized in experiment such as PC, mutual assessment, experiment form, etc. are used more, the principal component score for utilized media also tends to get smaller.

The correlation coefficient between principal component scores concerning utilized media and awareness came out to be r=-0.69*. The medium degree of correlation is significantly recognized for its significance. The finding shows that increase in awareness is more in subjects that utilizes media necessary for experience oriented activities.

9. Conclusion

With respect to 10 subjects that implemented blended class, significant difference test was conducted using rating values of awareness. Principal component analysis was conducted for average score of 124 items of 4 types of data related to ability and awareness. 10 subjects were categorized through cluster analysis on awareness and the number of activities. Discriminant analysis was conducted for 3 types of classes to find the important item for the group. Principal component analysis was conducted for the use degree of the media and the mean time required of the activity. Subjects were arranged using principal component scores. Correlation analysis is conducted using principal component scores to find relation between 3 kinds of principal component scores.

As such results, the followings were obtained:

1. For lecture type class G1, the average number of rating item recognized for significant difference or such tendency was approximately 50.7%.

2. For exercise type class G2, the average number of rating items recognized for significant difference or such tendency was approximately 63.3%.

3. For the average of experiment type class, significant difference was recognized for most of the rating items, and the average number of rating items recognized for significant difference was approximately 98.9%.

4. As results of the significant difference tests for general awareness, the subjects in the lecture type and the exercise type are divided into subjects whose number of significantly improved item are 70% or more and is 43% or less. In response to it, subjects are divided into subjects with small elongation of awareness and subjects with large one.

5. Awareness related to subject improved with the items more than 72% for all of subjects.

6. With respect to all of the subjects including general awareness and awareness related to subjects, significant improvement is shown on average rating score for all of awareness items.

7. Due to the change of affiliation of 2 subjects, 10 subjects can be categorized into 3 groups which are “experiment type class G3”, “exercise type class G2”, and “lecture type class G1” through principal component 1 and 2.

8. The awareness improves in the order of group “experiment type class G3”, “exercise type class G1”, and “lecture type class G2”, and this finding is in the order of commonly shared idea and image.

9. Awareness of “experimental type class G3” gave indication of greater elongation than that of “exercise type class G2” and “lecture type class G1”.

10. Awareness of subjects improves mostly in order of Group “experimental type class G3”, “exercise type class G2”, and “lecture type class G1”.

11. As the experience oriented activity time gets longer, the improvement in awareness is also increased.

12. More increase in awareness is shown on subjects that utilize media necessary for experience oriented activities.

As a future challenge, not just limiting to these 10 subjects that were object of this analysis, but we would also like to analyze rating score of ability and awareness survey for other subjects, to further solidify the information gained in this paper.

Acknowledgement

Part of this research was done in response to the aid of the Grant-in-Aid for Scientific Research, foundation study (C) “25350364” provided by the Ministry of Education, Culture, Sports, Science and Technology, Japan for this research. The author would like to express appreciation to the students who were surveyed and who helped me collect educational information.

References

[1]	Adachi, K., “Analysis of the classification of the learners’ activities in blended learning,” Japan Journal of Educational Technology, 3 (1), 29-40, 2007.
	In article
[2]	Bersin, J., The Blended Learning Book: Best Practices, Proven Methodologies, and Lessons Learned. John Wiley & Sons, Inc., San Francisco, USA, 2004.
	In article
[3]	Central Council for Education or Construction of College Program Education (Report), https://www.meti.go.jp/press/20080627007/20080627007-3.pdf, 2008.
	In article
[4]	Miyaji, I. and Yoshida K., “The Practice and Learning Effect of Education by Bending of Lecture and E-learning”, Transactions of Japanese Society for Information and Systems in Education, l.22 (4). 230-239. 2005.
	In article
[5]	Miyaji, I., “The Practice and the Evaluation of Experiment in Which Students Make the CAI Teaching Materials to Foster the Problem Solution Ability,” Japan Journal of Educational Technology, 29 (Suppl.). 25-28, 2006.
	In article
[6]	Miyaji, I., Yoshida, K. and Naruse, Y., “Effects of Blending E-learning and Lectures Utilizing a Structured Notebook”, Transactions of Japanese Society for Information and Systems in Education, 24 (2). 208-215. 2007.
	In article
[7]	Miyaji, I. (Ed.), Toward Blended Learning from E-learning, Kyouritu-Shuppan, Tokyo, Japan, 2009.
	In article
[8]	Miyaji, I., “Effects on Blended Class Which Incorporates E-learning Inside the Classroom,” In G. Richards (Ed.), Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2009, pp.1818-1826, 2009.
	In article
[9]	Miyaji, I., “Comparison between the Blended Classes Which Incorporate E-learning inside and outside the Classroom,” Proceedings of The 17th International Conference on Computers in Education ICCE2009, KONG, S.C., et al. (Eds.), Hong Kong, 306-310, 2009.
	In article
[10]	Miyaji, I., “Comparison between Effects in Two Blended Classes Which E-learning is Used inside and outside Classroom,” US-China Education Review, USA，8 (4), 468-481, Apr. 2011.
	In article
[11]	Miyaji, I., “Effects of blended class on teaching method for information studies by creation of a learning guidance plan and peer evaluation,” Journal of Japanese Association for Education of Information Studies, 4 (1), 11-19, 2011.
	In article
[12]	Miyaji, I., “Effects of Creating Three Kinds of Digital Storytelling on Student Attitude,” Journal of Modern Education Review, 2 (5), 243-262, 2012.
	In article
[13]	Miyaji, I., “Effects of Blended Learning in “History of Computers,” Proceeding of Hawaii International Conference on Education, HICE2013, 2645-2651, Honolulu, USA, Jan. 2013.
	In article
[14]	Miyaji, I., “Blended Lesson of Teaching Method for Information Studies Assisting Participants in Producing a Learning Guidance Plan,” Proceedings of IADIS International Conference e-Learning 2013, 473-475, Prague, Czech, July, 2013.
	In article
[15]	Miyaji, I. and Yoshida, K., “Effects of Blended Lessons of Teaching Method for Information Studies in Which Students Complete the Given Assignments,” Proceedings of IEEE Region 10 Humanitarian Technology Conference 2013, 321-326, Sendai, Japan, Aug. 2013..
	In article		View Article
[16]	Miyaji, I., “Change of Awareness Related to Ability and Recognition Degree of Terms in the Exercise-centered and Blended Class Using Clicker,” Proceedings of the London International Conference on Education, LICE 2013, 315-320, London, Dec. 2013.
	In article
[17]	Miyaji, I., “Effects of Blended Class on “History of Computers” with Peer Assessment for an Assignment to Introduce a Historical Character,” Journal of Modern Education Review，3 (10), 760-770, Mar. 2014.
	In article
[18]	Miyaji, I., “Analysis of Blended Classes on Operations Research Focusing on Practice,” Proceeding of The Sixth International Conference on Mobile, Hybrid, and On-line Learning, eLmL2014, 102-107, Barcelona, Spain, Mar., 2014.
	In article
[19]	Miyaji, I., “Effects in Blended Classes That Utilize Clickers to Deepen Understanding of Information Technology,” Literacy Information and Computer Education Journal (LICEJ), 5 (2), 1439-1447, June, 2014.
	In article
[20]	Miyaji, I. and Yoshida, K., “Improvement of the Attitudes and Their Familiarity with Terminology of a Programming Course with a Blended Learning Structure,” Proceedings of the Canada International Conference on Education, CICE 2014, 301-307, Sydney, Canada, June, 2014.
	In article
[21]	Miyaji, I., “Useful Activities for Improving the Attitudes in a Programming Course with a Blended Class,” Proceedings of the 4th Annual International Conference Education & E-Learning, EeL 2014, 81-89, Bangkok, Thailand, Aug., 2014.
	In article		View Article
[22]	Miyaji, I., “Useful Activities for Improving Awareness in Blended Classes on Operations Research Focusing on Practice,” Proceedings of the London International Conference on Education, LICE 2014, 159-164, London, Nov. 2014.
	In article		PubMed
[23]	Miyaji, I. and Yoshida, K., “Categories of Attitude and Student Determined by Cluster Analysis of the Attitudes toward Programming Abilities in a Blended Class,” International Journal Cross-Disciplinary Subjects in Education (IJCDSE), 5 (4), 1845-1853, Dec., 2014.
	In article
[24]	Miyaji, I., “Effects in Blended Classes on Operations Research by the Practice,” International Journal of Technology and Inclusive Education, 4 (2), 625-635, Dec., 2015.
	In article
[25]	Miyaji, I., “Classification of Blended Classes Using Change of Attitude Related to Ability,” Education Abstracts of the 17th Annual International Conference on Education, pp.165-167, Athens, Greece, May, 2015.
	In article