• <tr id="yyy80"></tr>
  • <sup id="yyy80"></sup>
  • <tfoot id="yyy80"><noscript id="yyy80"></noscript></tfoot>
  • 99热精品在线国产_美女午夜性视频免费_国产精品国产高清国产av_av欧美777_自拍偷自拍亚洲精品老妇_亚洲熟女精品中文字幕_www日本黄色视频网_国产精品野战在线观看 ?

    Development of Implicit and Explicit Knowledge of GrammaticalStructures in Chinese EFL Learners

    2014-09-11 10:03:46MANLIXIAOQINGQIN
    當(dāng)代外語(yǔ)研究 2014年12期

    MAN LIXIAOQING QIN

    University of Maryland, USACentral China Normal University, China

    DevelopmentofImplicitandExplicitKnowledgeofGrammaticalStructuresinChineseEFLLearners

    MAN LIXIAOQING QIN

    University of Maryland, USACentral China Normal University, China

    Although the theoretical distinction between implicit and explicit knowledge of a second language has long been recognized, minimal documented description exists of the development of the two types of knowledge in L2 learners due to the difficulty in finding separate measures of the two types. To address this gap, this study first investigated the construct validity of the four tests developed by R. Ellis (2005) intended to distinguish between the two knowledge types: an oral imitation test, a timed grammaticality judgment test (GJT), an untimed GJT and a metalinguistic knowledge test. The four tests, all examining 17 English grammatical structures, were administered to 88 native speakers of Chinese studying English as their major at the first three year levels in a Chinese university. The results from a confirmatory factor analysis (CFA) confirmed the two-factor solution for the implicit/explicit model proposed in R. Ellis (2005). Repeated measures ANOVA was then used to reveal developmental trends of the two knowledge types in the EFL learners across the three year levels. The results showed that learners at higher year level (or higher proficiency level) generally had higher level of both implicit and explicit knowledge of grammatical structures, and overall, the Chinese EFL learners possessed higher level of explicit knowledge than implicit knowledge. With regard to individual grammatical structures, the results of this study confirmed R. Ellis’ (2006b) finding that the level of difficulty of grammatical structures varied according to whether it was implicit or explicit knowledge of the structures involved.

    implicit knowledge, explicit knowledge, grammatical structure, L2 development, Chinese learners of English

    INTRODUCTION

    A theoretical distinction between implicit and explicit learning of a second language was first proposed by Krashen (1981) and Bialystok (1978). This distinction at theprocesslevel between the two types of learning entailed the distinction at theproductlevel between implicit and explicit language knowledge that an L2 learner may possess. These distinctions as well as the interfaces between them (both at theprocesslevel and at theproductlevel) have attracted considerable debate and research in the fields of both cognitive psychology and second language acquisition (SLA) over the last three decades (e.g., DeKeyser, 1995, 1998, 2003; N. C. Ellis, 1994, 2005, 2007; R. Ellis, 1994b, 2004, 2005; Hulstijn, 2005; Krashen, 1981, 1994; Paradis, 1994; Tokowicz & MacWhinney, 2005). As one major goal of SLA research is to describe the development of L2 linguistic knowledge (R. Ellis, 1994a, 2005; R. Ellis, Loewen, & Elder, 2009), the distinction and relationship between implicit and explicit knowledge are of particular interest in SLA.

    Though the existence and distinction of implicit and explicit knowledge are now commonly held (e.g., DeKeyser, 2003; N. C. Ellis, 1994, 2007; R. Ellis, 1994b, 2004, 2005; R. Ellisetal., 2009; Krashen, 1981, 1994; Paradis, 1994), the relationship between the two types of knowledge, which has been discussed in terms of the interface between them (N. C. Ellis, 1994), remains a central topic of continuous debate in SLA. Specifically, the issue mainly concerns the role of explicit knowledge in the development of implicit knowledge, and the question asked is whether explicit knowledge of a second language can become implicit (DeKeyser, 2003; N. C. Ellis, 1994, 2005; R. Ellis, 1997, 2005; Krashen, 1981, 1994; Paradis, 1994).

    Regarding this question, researchers have identified three distinct positions—the non-interface, the strong interface and the weak interface. Krashen firmly holds to the non-interface position arguing for the separateness of implicit (“acquired”) and explicit (“l(fā)earned”) knowledge. He rejects the possibility of transfer of knowledge from explicit to implicit. This position has been forcibly argued by Paradis (1994), who finds neurological evidence for the separate representation of the two types of knowledge. Acknowledging the possibility of interaction between the two knowledge systems, Paradis disputes that there is transformation between the two types of knowledge. The strong interface position, as argued by DeKeyser (1998, 2003), on the contrary, holds that explicit knowledge can be turned into implicit through practice. In his later work, he further clarifies that the strong interface hypothesis does not imply that the more there is of implicit knowledge, the less there is of explicit knowledge in the sense of metamorphosis (DeKeyser, 2009). On the other hand, DeKeyser (2009) posits that the presence of explicit knowledge plays a “causal” role in the development of implicit knowledge (p. 127).

    The weak interface position taken by R. Ellis (1993) claims that explicit knowledge can convert into implicit knowledge only when the learner is developmentally ready. R. Ellis (2006a) later proposes that explicit knowledge can facilitate the processes responsible for implicit learning, such as noticing the gap. Acknowledging that implicit and explicit knowledge are dissociative because they reside in different parts of the brain and involve different types of representations, N. C. Ellis (2005) argues for an indirect role of explicit knowledge as a facilitator of the development of implicit knowledge when he claims that a dynamic interface between explicit and implicit knowledge happens “transiently during conscious processing, but influence upon implicit cognition endures thereafter” (p. 305).

    The problem regarding the above debate is that discussions on these positions have stagnated at the level of theoretical modeling and are in need of subjecting to empirical inquiry (R. Ellis, 2005). Developing valid and reliable tests that measure implicit and explicit knowledge separately is essential to confirming whether explicit knowledge of a second language can become implicit (DeKeyser, 2003). R. Ellis (2005) makes an important attempt in SLA in this regard. In his study (R. Ellis, 2005), he established operational definitions of the two constructs, based on which five tests were developed to measure implicit and explicit knowledge of seventeen grammatical structures. In a follow-up study, R. Ellis (2006b) administered four of these five tests to a larger population of L2 learners to investigate learning difficulty of specific grammatical structures in relation to the two knowledge types and the differential contribution of the two types of knowledge to L2 proficiency. Clearly, the construct validity of the tests developed in R. Ellis (2005) is in need of further validation. Given the availability of relatively separate measures of the two knowledge types, one further step along this line of research is to investigate the development of the two types of knowledge in L2 learners, which has been recognized as one major goal of SLA research.

    The present study investigates the development of implicit and explicit knowledge of grammatical structures in Chinese learners of English in an EFL (English as a Foreign Language) context. The instruments used in this study were originally developed in R. Ellis (2005) and also used in his later study in 2006. This study set out to investigate the construct validity of the tests with a group of Chinese EFL learners. After the construct validity of the tests were confirmed, this study further explored the developmental trends of implicit and explicit knowledge of grammatical structures in the L2 learners at both the macro level (i.e., the overall development of implicit and explicit knowledge of grammatical structures) and the micro level (i.e., the development of the two types of knowledge of individual grammatical structures). Before delving into the details of this study, we will first review the methodological issues in the SLA literature of operationalizing the constructs of implicit and explicit knowledge and then discuss R. Ellis (2005) and R. Ellis (2006b) in more detail.

    Operationalizationofimplicitandexplicitknowledge

    When developing separate measures of implicit and explicit knowledge of a second language, it is critical to operationalize the distinction between the two types of knowledge. Dating back to the first dissociation between implicit and explicit systems, Krashen (1981) distinguishes between languageacquisition, which is “a subconscious process that results in linguistic knowledge that is subconsciously stored in the brain (tacit knowledge)” (Krashen, 1994, p. 45) and languagelearning, which is “a conscious process that results in knowledge about language” (Krashen, 1994, p. 45). He equates theacquiredandlearnedsystem with implicit and explicit knowledge (Krashen, 1982). As can be seen from his definition, the presence or absence of consciousness is what distinguishes the two types of knowledge. R. Ellis (2005) identifies seven criteria by which implicit and explicit linguistic knowledge can be distinguished—degree of awareness, time available, focus of attention, systematicity, certainty, metalinguistic knowledge and learnability (p. 152). Implicit knowledge is thus defined here as nonverbalizable procedural knowledge of language which is unconscious, unanalyzed and automatized, and is therefore easily retrievable for spontaneous language performance. Explicit knowledge, however, tends to be learned and is conscious, declarative, verbalizable, and accessible only via controlled processing when L2 learners experience linguistic difficulty in the use of L2. Among the seven criteria, R. Ellis emphasizes “conscious awareness” as the defining feature that sets the two types of knowledge apart.

    Though it is now generally accepted that the criterion ofconsciousnessis the intrinsic characteristic of the distinction between implicit and explicit knowledge (N. C. Ellis, 1994, 2005, 2007; R. Ellis, 2004, 2005, 2008; Hulstijn, 2005; Krashen, 1981, 1982, 1994; Paradis, 1994), consciousness is difficult, if not impossible, to subject to scientific investigation (Searle, 2000), and a number of alternatives have been developed to operationalize the distinction, such as articulability (Butler, 2002; Green & Hecht, 1992; Hu, 2002; Sorace, 1985), and automaticity (Bialystok, 1978, 1979; R. Ellis, 1984; Jiang, 2004, 2007).

    In terms of the operationalization of L2 explicit knowledge, R. Ellis (2004) provides a critical review and argues that explicit knowledge should be investigated primarily as analyzed knowledge and secondarily metalanguage. The two methods that have been most often used in measuring L2 explicit knowledge are grammaticality judgment tasks (GJT) and tests of metalinguistic knowledge (R. Ellis, 2004). Using some versions of the GJT, most studies (Alderson, Clapham, & Steel, 1997; Bialystok, 1979; Green & Hecht, 1992; Han & Ellis, 1998; Hu, 2002; Masny, 1987; Sorace, 1985) asked participants to (a) identify the error in an ungrammatical sentence, (b) correct the error, and (c) verbalize the rule that has been violated, except that Green and Hecht (1992) omitted (a) and Masny (1987) omitted (c). Learners were considered to have explicit knowledge if they could state the rules in addition to correcting the errors. Though articulability as a criterion of the distinction between implicit and explicit knowledge is much easier to operationalize, and tasks that ask learners to articulate grammatical rules elicit explicit knowledge, many researchers caution that such verbal report tasks can only provide a rather conservative picture of explicit knowledge that a L2 learner may have (e.g., Bialystok, 1979; R. Ellis, 2004; Hu, 2002). L2 learners may have explicit knowledge of a rule but cannot verbalize it simply because they do not have the necessary language to articulate it (Hu, 2002). A receptive test of metalinguistic knowledge instead has been recognized as a better option. Bialystok (1979) and R. Ellis (2005) asked learners to indicate from a list of rules which rule was violated after they had judged and identified the error. A number of studies also tested learners’ ability to identify named grammatical features (e.g., Aldersonetal., 1997; R. Ellis, 2005).

    When talking about the measurement of implicit language knowledge, Hulstijn and De Graaff (1994) note that implicit knowledge is such a theoretical construct that it cannot be directly accessed by language tasks. The behavioral correlate of implicit knowledge has been generally viewed as automaticity in language use (Hulstijn & De Graaff, 1994; Schmidt, 1994). In SLA research, the instruments most frequently used include free language production (R. Ellis, 2002, 2005; Han & Ellis, 1998), oral elicited imitation (R. Ellis, 2005; Erlam, 2006), and Timed grammaticality judgment test (R. Ellis, 2005, 2006b; Han & Ellis, 1998).

    Free language production has often been used to measure language gains when researchers investigate the effectiveness of L2 instruction (see reviews by R. Ellis, 2002; Norris & Ortega, 2000). It is believed that when L2 learners are engaged in unplanned, meaning-focused speech production, they rely on implicit competence rather than explicit knowledge (R. Ellis, 1994b, 2005; Schmidt, 1994). This approach of measuring implicit knowledge, however, is not free of criticism. One major criticism is that free language production tasks do not preclude the involvement of explicit knowledge. As R. Ellis (2002) points out, “free-production tasks make it difficult but not impossible for learners to perform on the basis of explicit knowledge” (p. 234). The problem is that learners can retrieve their explicit knowledge to monitor their language production even under time pressure (Jiang, 2004). Another shortcoming of free production tasks is the difficulty in targeting the specific structures that a study aims to elicit, which further makes it difficult to rate (Erlam, 2006).

    The oral elicited imitation test is another kind of test that has been used to measure implicit knowledge (e.g., R. Ellis, 2005; Erlam, 2006). In R. Ellis (2005) and Erlam (2006), participants were first asked to indicate their beliefs about a statement they heard, and then to repeat the statement in correct English. Of note is that half of the statements were grammatical and the other half ungrammatical. The assumptions behind the design of the test were firstly that requiring participants to respond to the meaning of a sentence reduced the likelihood of focusing on linguistic form and thus reduced the likelihood of their access to explicit knowledge, and secondly that their spontaneous correction of the ungrammatical sentences would be a powerful indication of their internalized language knowledge (Erlam, 2006). This approach is superior to the free language production to the extent that it is easier for researchers to target specific structures they want to elicit, and is therefore easier to rate. However, the validity of the oral elicited imitation test cannot be assured unless its “reconstructive” nature is guaranteed. If the design of the task allows for simple rote imitation, the elicited response may not be an accurate reflection of the participants’ internalized implicit linguistic knowledge. Another problem similar to free language production is that participants can still use their explicit knowledge to monitor their output when they are asked to repeat the sentence.

    Compared with free language production and oral elicited imitation, which are productive tests by nature, a GJT only involves receptive language use, which can be considered as a promising method in measuring implicit knowledge. A large body of literature has emerged on the validity and reliability of GJTs as measures of L2 knowledge (e.g., R. Ellis, 2004; Gass, 1994; Han, 2000; Loewen, 2009; Mandell, 1999; Murphy, 1997). The key construct validity issue concerns what a GJT measures—explicit knowledge, implicit knowledge or a mix of both. It seems that what type of knowledge a GJT measures depends on certain test conditions—presence or absence of time pressure, presentation modality of test materials (auditory or written) and task stimulus (grammatical or ungrammatical). The untimed GJT with written presentation of ungrammatical sentences tends to encourage learners to access explicit L2 knowledge whereas the timed written GJT (grammatical items) appears more conducive to measuring implicit L2 knowledge (e.g., R. Ellis, 2005; Han & Ellis, 1998; Loewen, 2009). Auditory GJT (e.g., Murphy, 1997; Whong-Barr & Schwartz, 2002) has been considered to be conducive to measuring implicit knowledge.

    One issue with auditory GJT is its difficulty in interpreting the test results because it requires both grammaticality competence and phonological decoding ability to successfully complete the task. As Jiang (2004) notes, for EFL learners who learn English as a foreign language, their poor performance on an auditory GJT can be attributed more to their poor phonological decoding ability than to their insufficient grammatical competence. Johnson (1992) provided evidence that when the same test items were presented to the same participants in a written format, significant improvement were made. The phonological decoding factor can indeed be eliminated when test stimuli are in writing; however, it creates the problem of potential involvement of explicit knowledge (Jiang, 2004). When a sentence is visually presented, test takers can go back and forth to check the grammar. This is why a time constraint is extremely important in such a task. However, even a timed GJT task cannot completely eliminate the potential involvement of explicit knowledge. To summarize, both an auditory GJT and a timed written GJT have their limitations as measures of implicit L2 knowledge, either inviting an interwoven phonological decoding factor, or allowing for the involvement of explicit knowledge.

    The above review of the methodological issues in measuring implicit and explicit L2 knowledge does not reveal a rosy picture for finding pure and exhaustive measures of the two types of knowledge. DeKeyser (2003) commented that “at this point researchers have to content themselves with eliciting knowledge under conditions that are more or less conducive to the retrieval of implicit and explicit knowledge” (p. 319). Though the behavioral measures are unlikely to provide pure and exhaustive measures of implicit and explicit knowledge, researchers did find that these tests are more likely to separately measure them. The construct validity of these tests as separate measures of implicit and explicit knowledge is in need of empirical validation.

    R.Ellis(2005, 2006b)

    In order to address the construct validity of the tests used to measure implicit and explicit knowledge in SLA studies, R. Ellis (2005) proposed a set of seven criteria to distinguish implicit and explicit knowledge. Based on these criteria, he further developed a battery of five tests—an oral imitation test, an oral narrative test, a timed GJT, an untimed GJT, and a metalinguistic knowledge test, with the first three hypothesized to measure implicit knowledge and the latter two explicit knowledge. All the five tests examined 17 English grammatical structures. The tests were administered to 20 native speakers of English and 91 learners of English at a university in New Zealand. R. Ellis (2005) then used an exploratory factor analysis (EFA) to analyze the scores for the five tests and drew a two-factor solution with the scores for the first three tests loading on the first factor and the scores for ungrammatical items in untimed GJT and metalinguistic knowledge test loading on the second factor, which were interpreted as implicit and explicit knowledge, respectively. Isemonger (2007) criticized R. Ellis (2005) for using an EFA on the grounds that the design of the study had a prior model and a verificational agenda, and suggested that a confirmatory factor analysis (CFA) be used. R. Ellis and Loewen (2007) then used CFA and confirmed the construct solution of the implicit/explicit model predicted by the design of the study.

    In a follow-up study, R. Ellis (2006b) administered four of the five tests to a larger population of L2 learners (N=220) in order to investigate how learning difficulty of the grammatical structures is related to the two knowledge types and how the two knowledge types are related to L2 proficiency. In order to determine whether some grammatical structures were easy in terms of explicit knowledge but difficult in terms of implicit knowledge and vice versa, R. Ellis calculated the difference score between explicit and implicit knowledge for each grammatical structure. Those difference scores, however, were not tested for statistical significance, so it is not clear whether the differences were meaningful or due to random error. This study also attempted to explore the relationship between the two types of knowledge and L2 proficiency, which was operationalized as the four language skills—listening, speaking, reading and writing—as measured by the International English Language Testing System (IELTS). Generally, low to medium positive correlations were found between implicit/explicit knowledge of specific grammatical structures and the IELTS scores (total, listening, speaking, reading and writing), indicating that the development of L2 proficiency entails the development of implicit and explicit knowledge of grammatical structures. However, the development of implicit and explicit knowledge in L2 learners was not the focus of the study.

    THE STUDY

    The goal of the present study was twofold. First, it was set up to investigate the construct validity of four of the tests originally developed in R. Ellis (2005) on a different population, i.e., Chinese learners of English in an EFL context. Second, it attempted to reveal the developmental trends of implicit and explicit knowledge of grammatical structures in the L2 learners at both the macro level, i.e., the overall development of implicit and explicit knowledge of grammatical structures, and the micro level, i.e., the development of the two types of knowledge of specific grammatical structures. In accordance with the purposes of the study, the following research questions (RQs) were formulated:

    1. Do the four tests—the oral imitation test, the timed GJT, the untimed GJT and the metalinguistic test—measure two distinct constructs (i.e., implicit and explicit knowledge)?

    2. What are the developmental trends ofoverallimplicit and explicit knowledge of grammatical structures in Chinese learners of English?

    3. What are the developmental trends of implicit and explicit knowledge ofspecificgrammatical structures in Chinese learners of English?

    Participants

    Participants in this study were native speakers of Chinese studying English as a foreign language in China. They were 88 undergraduate students majoring in English language and literature at a major university in China, ranging in ages from 18 to 22 years. The participants consisted of 30 students in Year One, 30 in Year Two, and 28 in Year Three of a four-year program, among which 26 were male and 65 were female. All participants had finished at least 6 years of junior and senior high school English education. None of the participants had ever any experience of studying in or living in an English-speaking country.

    Instruments

    This study used four of the five tests developed by R. Ellis’ (2005). The oral narrative test was not used in the study due to its difficulty in targeting specific structures. This study also used the same test items as those by R. Ellis (2005). The 17 grammatical structures and their properties were summarized by R. Ellis (2005) in Table 1. His choice of the grammatical structures was motivated by a number of considerations. First, all the selected grammatical structures were problematic to learners, resulting in identifiable errors. Second, they were representative of a full range of structures acquired at both early and late stages in L2 acquisition. Third, they were representative of a broad range of proficiency levels according to a typical teaching syllabus. Finally, they included both morphological and syntactical structures.

    Table 1 Target Grammatical Structures (from R. Ellis, 2005, p. 155)

    Note. S=syntactic; M=morphological.

    OralImitationTest

    This test was comprised of a set of 34 belief statements, involving one grammatical sentence and one ungrammatical sentence for each of the 17 target structures. The sentences were aurally presented to participants one at a time by a Windows Media Player on a Dell laptop. The participants were required to first complete an answer sheet indicating whether they agreed with, disagreed with, or were not sure about the content of each statement and then to repeat the sentences orally in correct English. Their responses were audio recorded. The whole process of participants taking this test was monitored by the first author in order to ensure that each participant indicated their belief about each statement before they repeated the sentence.

    The responses were analyzed by identifying obligatory occasions for the use of target structures. Test takers’ failure to imitate a sentence or to reproduce it in a form that lacked an obligatory occasion for the target structure was coded as avoidance. Each imitated sentence was allocated a score of either 1 (the target structure was correctly supplied) or 0 (the target structure was either avoided or attempted but incorrectly supplied). Scores were expressed as percentage correct.

    TimedGrammaticalityJudgmentTest

    This was a computer-delivered test consisting of 68 sentences (4 per grammatical structure: 2 grammatical and 2 ungrammatical). The sentences were different from those in the oral imitation test and were presented in written form on a computer screen. Participants were required to indicate whether each sentence was grammatical or ungrammatical by pressing response buttons within a fixed time limit of 6.5 seconds①.

    The participants were asked to judge the grammaticality of each sentence as quickly as they could via their feel of the sentence. Participants were told that both their response time and judgment for each sentence would be recorded by the computer and used as data for the study. They were also told that if their response time for a sentence exceeds the time limit, that question would be left unanswered, resulting in being scored as incorrect. Each item was scored dichotomously as correct/incorrect. A percentage accuracy score was calculated.

    UntimedGrammaticalityJudgmentTest

    This was a paper-delivered test with the same items as in the timed GJT. The participants were required to (a) indicate whether each sentence was grammatical or ungrammatical, (b) indicate the degree of certainty of their judgment as 0%, 20%, 40%, 50%, 60%, 80% or 100%, and (c) to self-report whether they usedruleorfeelfor judging each sentence. Thus, this test provided three separate measures: a percentage judgment accuracy score, a percentage certainty score, and a percentage score based on the participants’ reported use of rule in judging each item.

    MetalinguisticKnowledgeTest

    This was an untimed paper-based test in two parts. The first part presented the participants with 17 ungrammatical sentences (one sentence for each target structure) and required them to select the rule that best explained each error out of four choices provided. The second part had two sections. In the first section, the participants were asked to read a short text and then to find examples of 19 specific grammatical features from the text. In the second section, they were asked to identify the named grammatical parts in a set of sentences. A total percentage accuracy score was calculated.

    ProcedureEach participant came to a private office and completed the four tests individually in the following order: the oral imitation test, the timed GJT, the untimed GJT and the metalinguistic knowledge test. The directions for each test were first delivered in English either aurally in the oral imitation test or in written form in the other three tests, and then explained by the researcher in Chinese. The battery of four tests was completed in a single session, and the administration time for the complete set of tests ranged approximately from one hour to one and a half hours.

    Analysis

    Two phases of statistical analysis were conducted. In Phase 1, the purpose was to examine the construct validity of the four tests in response to the first RQ. The internal consistency reliability of the four psychometric tests was calculated using Cronbach’s Alpha. Descriptive statistics (means and standard deviations) for the four tests were also calculated. In order to validate the predictions about the type of knowledge each test measured and the argument about the number of factors that could be extracted, two confirmatory factor analyses using maximum likelihood estimation were performed using AMOS 5.0 (Arbuckle, 2004). The first analysis tested a one-factor construct solution. The second analysis tested the two-factor solution that was argued by R. Ellis (2005), i.e., the oral imitation test and the timed GJT would load on an implicit factor, and the untimed GJT (ungrammatical sentences) and the metalinguistic knowledge test would load on an explicit factor. The two models were then compared to find the best fitting model.

    The results in Phase 1 suggesting that the two-factor solution for the implicit/explicit model best fit the study’s data enabled us proceed to statistical analysis in Phase 2. To answer RQ 2 concerning the developmental trends of overall implicit and explicit knowledge of grammatical structures, a combined mean score for the oral imitation test and the timed GJT for all 17 grammatical structures was calculated as a measure of implicit knowledge, and a combined mean score for the ungrammatical sentences on the untimed GJT and the metalinguistic knowledge test was calculated as a measure of explicit knowledge. Then, a repeated measures ANOVA with year level (Year 1, Year 2 and Year 3) as a between-subjects factor and type of knowledge (implicit vs. explicit) as a within-subjects factor was conducted in order to examine (a) the effect of year level on the participants’ mastery of implicit and explicit knowledge of the grammatical structures, (b) the effect of type of knowledge, and (c) whether there was an interaction②between year level and type of knowledge. When significant differences were found with the three year levels, the Tukey’s post hoc test was used to locate the significant differences among pairs of the three levels.

    In order to answer RQ 3 concerning the developmental trends of implicit and explicit knowledge of each specific structure, a combined mean score for the oral imitation test and the timed GJT for each of the 17 structures was calculated, and a combined mean score for the untimed GJT (ungrammatical) and the metalinguistic knowledge test for each structure was calculated. Then, a repeated measures ANOVA with year level as a between-subjects factor and type of knowledge as a within-subjects factor for each grammatical structures was conducted to explore (a) the effect of year level on participants’ mastery of each of the grammatical structures, (b) the effect of type of knowledge for each structure, (c) whether there was an interaction between year level and type of knowledge for each structure. As 17 independent hypotheses were tested on the set of data, the Bonferroni correction method was used to maintain the familywise error rate (Abdi, 2007). Thus, each individual hypothesis was tested at a significance level of 0.003 (i.e., 0.05/17).

    RESULTS

    Table 2 presents means and standard deviations of the percentage accuracy scores for each of the four tests completed by the 88 Chinese participants as well as reliability measures for each test. The results demonstrate that the participants achieved the highest mean score on the untimed GJT test (M=0.91), followed by the timed GJT (M=0.82), then the metalinguistic knowledge test (M=0.67), and finally the oral imitation test (M=0.53). The dispersion of the distribution of the scores for each test was reflected by the standard deviations, ranging from .05 for the untimed GJT to .11 for the metalinguistic knowledge test. The Cronbach’s alpha values varied between 0.70 for the metalinguistic knowledge test and 0.57 for the oral imitation test, which will be discussed in detail in the discussion section.

    Table 2 Reliability and Descriptive Statistics for the Four Tests

    Constructvalidityofthefourtests

    Table 3 presents a summary of model fit statistics for both the one-factor and the two-factor solutions, with theχ2statistics (testing the goodness of fit), comparative fit index (CFI) and root mean square error of approximation (RMSEA) presented. The higher thepvalue associated withχ2, the closer the fit between the hypothesized model and the perfect fit, and a significant value represents a statistically unlikely event (i.e., a misfitting model) (Byrne, 2001). As can be seen from this table, the one-factor model yielded aχ2value of 13.125, with 2 degrees of freedom and a probability of 0.001, thereby suggesting that the fit of the data to this hypothesized model is inadequate. The two-factor solution for the implicit/explicit model had aχ2value of 1.602 with a probability of 0.206, indicating that this model fits the data. Values for the CFI range from zero to 1.00, and a value>0.95 is considered representative of a well-fitting model (2001). Here we can see that the CFI value for the one-factor model was far lower than the threshold of 0.95, thereby indicating that the model was inadequate. The CFI value for the implicit/explicit model, however, was 0.984, thus adding more evidence that the implicit/explicit model represented an adequate fit to the data.

    The RMSEA takes into account the error of approximation in the population and this index depends on the degrees of freedom and sample size. It has been advised that values less than 0.05 indicate good fit, values as high as 0.08 represent reasonable errors of approximation in the population, values ranging from 0.08 to 0.10 indicate mediocre fit, and those greater than 0.10 indicate poor fit (Byrne, 2001). The table shows that the implicit/explicit model yielded a RMSEA value of 0.083 while the one-factor model produced a value of 0.254. It is found by Chenetal. (2008) from an empirical evaluation that when the degrees of freedom are small and sample size is not large (n≤100), a 0.05 cutoff value of the RMSEA tends to over-reject true population models. Because the sample size was relatively small and the degree of freedom of the implicit/explicit model was only 1, it is arguable that the RMSEA value as low as 0.083 indicated an adequate fit for this model. Thus, all the above indices indicate that the one-factor model does not fit while the implicit/explicit two-factor model adequately fits the data in this study.

    Table 3 Summary of the model of fit for the two models

    Note: CFI=comparative fit index; RMSEA=root mean square error of approximation.

    **p<0.00.

    Developmentofoverallimplicitandexplicit

    knowledgeofgrammaticalstructures

    Since the hypothesized implicit/explicit two-factor construct model was confirmed by the confirmatory factor analysis, a combined mean score for the oral imitation test and the timed GJT was calculated as a measure of implicit knowledge, and a combined mean score for the ungrammatical sentences on the untimed GJT and the metalinguistic knowledge test was calculated as a measure of explicit knowledge. The reliability for the measures of implicit and explicit knowledge is presented in Table 4. As can be seen, the Cronbach’s alpha value for implicit knowledge was 0.70 and 0.74 for explicit knowledge, indicating that the measures for the two types of knowledge were sufficiently reliable. The means and standard deviations of the percentage accuracy scores in terms of implicit and explicit knowledge across year levels are presented in Table 5.

    Table 4 Reliability for Implicit and Explicit Measures

    Table 5 Descriptives for Implicit and Explicit Measures

    Figure 1 Mean scores for implicit and explicit knowledge across year levels

    Developmentofimplicitandexplicitknowledgeofspecificgrammaticalstructures

    Developmentofimplicitandexplicitknowledgeofspecificgrammaticalstructuresacrossyearlevels

    A repeated measures ANOVA for each grammatical structure with year level (Year 1, Year 2, and Year 3) as a between-subjects factor and type of knowledge (implicit vs. explicit) as a within-subjects factor was conducted. The equality of variance assumption was not met for each structure. Statisticians note that if group sizes are equal or approximately equal (largest/smallest<1.5), theFstatistics is robust for unequal variance (Steven, 2007). In this study, the group sizes were almost equal with two groups having 30 participants in each and the other group 28 participants, thus the repeated measures ANOVA could proceed accurately.

    Differencescoresbetweenexplicitandimplicitknowledgeofspecificgrammaticalstructures

    Table 6 presents the means and standard deviations for the 17 grammatical structures in both implicit and explicit knowledge and the differences between explicit and implicit mean scores. The structures are listed in the descending order of the mean difference between explicit and implicit knowledge. The mean scores for both implicit and explicit knowledge of each structure are presented graphically in Figure 2.

    The result from the repeated measures ANOVA for each grammatical structure showed that participants scored significantly higher in explicit measures than in implicit measures on 12 grammatical structures—unreal conditionals, comparative, indefinite article, embedded questions, plural, question tags, verb 3rdperson -s, regular past tense -ed, since/for, possessive -s, relative clauses, and verb complement. Conversely, significantly higher score in implicit measures than in explicit measures was found only on one grammatical structure modals. For the other four structures, no significant difference was found in scores between implicit and explicit measures.

    Table 6 Means and Standard Deviations of Explicit and Implicit scores for 17 Grammatical Structures and Differences between Explicit and Implicit Mean Scores (n=88)

    **p<0.003

    Figure 2 Implicit and explicit mean scores for the seventeen grammatical structures

    DISCUSSION

    Before discussing the results corresponding to each research question, we would like to first discuss the reliability of the four tests used in this study. This study employed the same four tests in R. Ellis (2005, 2006b)—the oral imitation test, the timed GJT, the untimed GJT, and the metalinguistic knowledge test. Compared with the reliability measures in R. Ellis’ studies (see Table 7), this study obtained overall lower Cronbach’s alpha values. It should be noted that this study used the identical testing items for the four tests as those in R. Ellis (2005, 2006b), therefore, the item quality of the tests were assured. In addition, the administrative procedures of the tests in this study were very similar to those in R. Ellis’ studies with the exception of the timed GJT. The overall lower Cronbach’s values for the four tests could probably be explained by the fact that the participants in this study were less various in terms of English proficiency as compared with those in R. Ellis’. As Cronbach’s alpha is a function of the population variance of the test scores (Bachman, 2004, p. 163; Brown, 2005, p. 179), the larger the variance of the test scores, the higher the value of Cronbach’s alpha. The lower alpha values in this study could be justified by the more uniform population variance of the test scores that can be seen from the much smaller standard deviations.

    Table 7 Reliability and Descriptive Statistics for the Four Tests in R. Ellis (2005, 2006b)

    Comparing the means and standard deviations for the four tests in this study with those in R. Ellis’ (2005, 2006b), it can be seen that participants in this study achieved higher mean scores with smaller standard deviations on each test. This indicates that participants in this study, who were English majors at a prominent university of China, probably had higher English proficiency than those in R. Ellis’ studies. The smaller standard deviations on the four tests indicates that the English proficiency of participants in this study were more uniform than that in R. Ellis’ studies.

    One notable difference between this and R. Ellis’ study is the substantially higher mean score for the timed GJT. One reason for this difference may be the different time constraints set for the timed GJTs in the two studies. In R. Ellis (2005), a time limit was established for each sentence based on 10 native speakers’ average response time for each sentence in a pilot study, and an additional 20% of the time taken for each sentence was added to allow for the slower processing speed of L2 learners, and the time limit for each sentence allowed for L2 learners ranged from 1.8 to 6.24 seconds. In this study, however, a time limit of 6.5 seconds was set for each sentence due to the difficulty of finding a reasonable number of native English speakers in the local area in China to set the baseline of the time limit for each sentence. The relatively less strict time limit in this study was compensated by asking participants to respond as quickly as they could, where they were told that both their response time and accuracy for each sentence would be recorded and used as data for the study. It is possible that the less rigorous time limit in the timed GJT in the study might have allowed time for participants to access some of their explicit knowledge on some sentences, even though they were asked to respond as quickly as possible.

    To investigate the first research question, i.e., whether the four tests measure two distinct constructs (i.e., implicit and explicit knowledge), two confirmatory factor analyses were performed. The results suggest that while the one-factor model does not fit the data, the two-factor solution for the implicit/explicit model fits. Specifically, it was confirmed that the oral imitation test and the timed GJT measure the construct of implicit knowledge while the untimed GJT ungrammatical items and the metalinguistic knowledge test measure the construct of explicit knowledge. The results of this study confirmed the construct validity of the four tests developed by R. Ellis (2005) as relatively separate measures of implicit and explicit knowledge on a different population of participants.

    The second research question concerned the developmental trends of overall implicit and explicit knowledge of grammatical structures in Chinese learners of English. The results suggest that there were significant improvement in terms of both implicit and explicit knowledge across year levels. Specifically, participants in Year 3 had significantly higher levels of both implicit and explicit knowledge of grammatical structures than those in Year 1, and no significant difference was found between Years 1 and 2 or between Years 2 and 3. The cross-sectional design of this study enables us to tentatively conclude that with the increase of L2 proficiency, adult L2 learners who learned English as a foreign language in China usually possess a higher level of both implicit and explicit knowledge of grammatical structures.

    The study also found that participants achieved significantly higher scores in the explicit knowledge measures than in the implicit knowledge measures. This indicates that EFL learners generally possess a significantly higher level of explicit knowledge of grammatical structures than that of implicit knowledge. One caveat is that the higher explicit knowledge scores might partly be an artifact of the test scoring procedures. The oral imitation test (meaning implicit knowledge) in this study was scored using obligatory occasion analysis whereas the ungrammatical GJTs and the metalinguistic knowledge test (measuring explicit knowledge) involve selective response scoring, which might have contributed to the higher explicit knowledge scores to a slight extent.

    Caution should also be taken when we attempt to generalize the findings from this particular population of participants to other populations even in EFL contexts. Of note is that the participants in this study were L2 learners who learned the English language as their major in an undergraduate degree program in China. In other words, one of their career goals was to teach the English language. Given that, it was not surprising that the participants improved their explicit knowledge along with higher year levels. English majors were more likely to be motivated to learn the metalinguistic knowledge of English than L2 learners in other majors who learned English for other purposes rather than teaching the language. Therefore, the findings may not be generalizable to non-English majors in this foreign context; neither should they be generalized to situations where learners acquire English as their second language in an English-speaking country. Further studies are clearly needed to reveal the developmental trend of implicit and explicit knowledge in other populations, such as non-English majors at college level in foreign contexts, EFL students at high school level, and English learners in ESL contexts.

    The third research question concerned the developmental trends of implicit and explicit knowledge of specific grammatical structures. The results suggest that implicit and explicit knowledge of only one grammatical structure verb 3rdperson -s improved significantly across year levels. Students in Year 3 did significantly better on verb 3rdperson -s than those in Year 1 and Year 2. For the other sixteen structures in terms of both implicit and explicit knowledge, no significant improvement was found across year levels. This finding is significant in that it documented the development of these 17 grammatical structures across proficiency levels in adult English learners in the context of China. It is difficult to say why and what exactly contributed to the significant improvement of implicit and explicit knowledge of this particular structure verb 3rdperson -s across year levels instead of the others. Further study of a longitudinal rather than cross-sectional design on the development of these grammatical structures in terms of both implicit and explicit knowledge would be more revealing about the process of acquisition.

    Comparing the scores for implicit and explicit knowledge on each grammatical structure allows us to see whether there were any grammatical structures that are easy in terms of one type of knowledge (implicit or explicit) but difficult in terms of the other type (R. Ellis, 2006b). This study found that 12 grammatical structures (i.e., unreal conditionals, comparative, indefinite article, embedded questions, plural, question tags, verb 3rdperson -s, regular past tense -ed, since/for, possessive -s, relative clauses, and verb complement) were significantly easier in terms of explicit knowledge than they were in terms of implicit knowledge. This implies that L2 learners in this EFL context may very well know the rules for these structures but have difficulty in using them accurately spontaneously. Conversely, when it comes to the structure of modals, with the testing point being that modals should be followed by the base form of the main verb, it was significantly easier in terms of implicit knowledge. For yes/no question, ergative verbs, dative alternation and adverb placement, no significant difference was found in scores between implicit and explicit measures. These results of this study with the support of inferential statistical analysis further confirmed the previous finding by R. Ellis (2006b) that the level of difficulty of grammatical structures varied according to whether it was implicit or explicit knowledge of the structures involved.

    CONCLUSION

    With the aim of describing the development of implicit and explicit knowledge of grammatical structures in Chinese learners of English, this study used the four tests developed by R. Ellis (2005) that were intended to distinguish the two types of knowledge. The construct validity of the four tests was first investigated, and results confirmed that the four tests tended to measure two distinct constructs—implicit and explicit knowledge. Based on this result the development of the two types of knowledge of grammatical structures in Chinese adult L2 learners of English was explored. It was found that learners with higher proficiency level had higher level of both implicit and explicit knowledge of grammatical structures, and overall, the learners possessed higher level of explicit knowledge than implicit knowledge. On the development of the seventeen individual grammatical structures, only verb 3rdperson -s improved significantly in terms of the two types of knowledge across year levels. In addition, it was found that the majority of the structures were much easier to learn as explicit knowledge than implicit knowledge for adult L2 learners in the foreign context.

    In terms of the interface between implicit and explicit knowledge of a second language, this study by the nature of design cannot directly address the question about the role of explicit knowledge on the development of implicit knowledge. However, this study is contributive in two aspects. First, it provided strong support for having available relatively separate measures of the two types of knowledge. It is only when sensitive measures of the two knowledge types are well established that we can empirically address the theoretical positions on the interface between them. Second, this study provided a description of the development of both types of knowledge of a wide variety of grammatical structures in a group of adult EFL learners. The finding that both types of knowledge increased with year level provides empirical evidence for the argument that explicit knowledge does not transform into implicit knowledge in the sense of metamorphosis (DeKeyser, 2009; Paradis, 1994) because explicit knowledge remains available or even increases after implicit knowledge is acquired.

    This study also has limitations. The validity of the findings depends heavily on the four tests used to measure the two types of knowledge. As has been discussed earlier, while the four tests were not pure measures of implicit or explicit knowledge, they are relatively separate measures of the two knowledge types. A timed GJT with more rigorous time limit and a self-paced word by word reading task (Jiang, 2004) could be more sensitive for measuring implicit knowledge. Future work on developing more sensitive measures of the two knowledge types, especially of implicit knowledge, is clearly needed.

    ACKNOWLEDGEMENTS

    This study was supported by the National Social Science Foundation of China (10BYY035) and National Research Centre for FL Education Foundation (ZGWYJYJJ2010A30). This study was presented at the 2010 American Association of Applied Linguistics conference. We are grateful to Rod Ellis and two other anonymousLanguageLearningreviewers for helpful comments on an earlier version. We are also grateful to Michelle Dove for proofreading this manuscript. Any remaining errors and omissions are of our own.

    NOTES

    1 This procedure was different from R. Ellis (2005), who established a time limit for each sentence on the basis of 10 native speakers’ average response time for each sentence in a pilot study, to which an additional 20% of the time taken for each sentence was added to allow for the slower processing speed of L2 learners. In his study, the time limit for each sentence ranged from 1.8 to 6.24 seconds.

    2 An interaction means that “the effect one independent variable has on the dependent variable is not the same for all levels of the other independent variable” (Steven, 2007, p. 125).

    Abdi, H. (2007). Bonferroni andidák corrections for multiple comparisons. In N. J. Salkind (Ed.),Encyclopediaofmeasurementandstatistics(pp. 103-107). Thousand Oaks: Sage.Alderson, J. C., Clapham, C., & Steel, D. (1997). Metalinguistic knowledge, language aptitude and language proficiency.LanguageTeachingResearch, 1, 93-121.

    Arbuckle, J. (2004).AMOS5.0. Chicago: Small Waters Corporation.

    Bachman, L. F. (2004).Statisticalanalysisforlanguageassessment. Cambridge: Cambridge University Press.

    Bialystok, E. (1978). A theoretical model of second language learning.LanguageLearning, 28(1), 69-84.

    Bialystok, E. (1979). Explicit and implicit judgements of L2 grammaticality.LanguageLearning, 29, 81-103.

    Brown, J. D. (2005).Testinginlanguageprograms:AcomprehensiveguidetoEnglishlanguageassessment(New ed.). New York: McGraw-Hill College.

    Butler, Y. (2002). Second language learners’ theories on the use of English articles.StudiesinSecondLanguageAcquisition, 24, 451-480.

    Byrne, B. M. (2001).StructuralequationmodelingwithAMOS:Basicconcepts,applications,andprogramming. Mahwah: Lawrence Erlbaum Associates.Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., & Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in Structural Equation Models.SociologicalMethods&Research, 36(4), 462-494.DeKeyser, R. M. (1995). Learning second language grammar rules: An experiment with a miniature linguistic system.StudiesinSecondLanguageAcquisition, 17, 379-410.

    DeKeyser, R. M. (1998). Beyond focus on form: Cognitive perspectives on learning and practicing second language grammar. In C. Doughty & J. Williams (Eds.),Focusonforminsecondlanguageacquisition(pp. 42-63). Cambridge: Cambridge University Press.

    DeKeyser, R. M. (2003). Implicit and explicit learning. In C. Doughty & M. Long (Eds.),Handbookofsecondlanguagelearning(pp. 313-348). Oxford: Blackwell.

    DeKeyser, R. M. (2009). Cognitive-pscychological processes in second language learning. In M. H. Long & C. Doughty (Eds.),Handbookofsecondlanguageteaching(pp. 119-138). Oxford: Blackwell.Ellis, N. C. (1994). Implicit and explicit processes in language acquisition: An introduction. In N. C. Ellis (Ed.),Implicitandexplicitlearningoflanguages(pp. 1-32). San Diego: Academic Press.

    Ellis, N. C. (2005). At the Interface: Dynamic interactions of explicit and implicit language knowledge.StudiesinSecondLanguageAcquisition, 27 (2), 305-352.

    Ellis, N. C. (2007). Implicit and explicit knowledge about language. In J. Cenoz & N. H. Hornberger (Eds.),Encyclopediaoflanguageandeducation,secondedition,volume6:Knowledgeaboutlanguage(pp. 119-132). Berlin: Springer.

    Ellis, R. (1984).Classroomsecondlanguagedevelopment. Oxford: Pergamon.Ellis, R. (1993). Second language acquisition and the structural syllabus.TESOLQuarterly, 27, 91-113.Ellis, R. (1994a).Thestudyofsecondlanguageacquisition. Oxford: Oxford University Press.

    Ellis, R. (1994b). A theory of instructed second language acquisition. In N. C. Ellis (Ed.),Implicitandexplicitlearningoflanguages(pp. 79-114). San Diego: Academic Press.

    Ellis, R. (1997).SLAresearchandlanguageteaching. Oxford: Oxford University Press.

    Ellis, R. (2002). Does Form-Focused Instruction affect the acquisition of implicit knowledge?StudiesinSecondLanguageAcquisition, 24(2), 223-236.

    Ellis, R. (2004). The definition and measurement of L2 explicit knowledge.LanguageLearning, 54(2), 227-275.

    Ellis, R. (2005). Measuring implicit and explicit knowledge of a second language: A psychometric study.StudiesinSecondLanguageAcquisition, 27(2), 141-172.

    Ellis, R. (2006a). Current issues in the teaching of grammar: An SLA perspective.TESOLQuarterly, 40(1), 83-107.

    Ellis, R. (2006b). Modelling learning difficulty and second language proficiency: The differential contributions of implicit and explicit knowledge.AppliedLinguistics, 27(3), 431-463.

    Ellis, R. (2008).Thestudyofsecondlanguageacquisition(2nd ed.). Oxford: Oxford University Press.

    Ellis, R., & Loewen, S. (2007). Confirming the operational definitions of explicit and implicit knowledge in Ellis (2005): Responding to Isemonger.StudiesinSecondLanguageAcquisition, 29(1), 119-126.

    Ellis, R., Loewen, S., & Elder, C. (2009).Implicitandexplicitknowledgeinsecondlanguagelearning,testingandteaching. Bristol: Multilingual Matters.

    Erlam, R. (2006). Elicited imitation as a measure of L2 implicit knowledge: An empirical validation study.AppliedLinguistics, 27(3), 464-491.

    Gass, S. (1994). The reliability of second-language grammaticality judgments. In E. Tarone, S. Gass & A. Cohen (Eds.),Researchmethodologyinsecondlanguageacquisition(pp. 303-322). Hillsdale: Erlbaum.

    Green, P. S., & Hecht, K. (1992). Implicit and explicit grammar: An empirical study.AppliedLinguistics, 13(2), 168-184.Han, Y. (2000). Grammaticality judgment tests: How reliable and valid are they?AppliedLanguageLearning, 11(1), 177-204.

    Han, Y., & Ellis, R. (1998). Implicit knowledge, explicit knowledge and general language proficiency.LanguageTeachingResearch, 2(1), 1-23.

    Hu, G. (2002). Psychological constraints on the utility of metalinguistic knowledge in second langauge production.StudiesinSecondLanguageAcquisition, 24(3), 347-386.

    Hulstijn, J. H. (2005). Theoretical and empirical issues in the study of implicit and explicit second-language learning: Introduction.StudiesinSecondLanguageAcquisition, 27(2), 129-140.

    Hulstijn, J. H., & De Graaff, R. (1994). Under what conditions does explicit knowledge of a second language facilitate the acquisition of implicit knowledge? A research proposal.AILAReview, 11, 97-113.

    Isemonger, I. M. (2007). Operational definitions of explicit and implicit knowledge: Response to R. Ellis (2005) and Some Recommendations for Future Research in This Area.StudiesinSecondLanguageAcquisition, 29(1), 101-118.Jiang, N. (2004). Morphological insensitivity in second language processing.AppliedPsycholinguistics, 25, 603-634.Jiang, N. (2007). Selective integration of linguistic knowledge in adult second language learning.LanguageLearning, 57(1), 1-33.

    Johnson, J. S. (1992). Critical period effects in second language acquisition: The effect of written versus auditory materials on the assessment of grammatical competence.LanguageLearning, 42, 217-248.

    Krashen, S. (1981).Secondlanguageacquisitionandsecondlanguagelearning. Oxford: Pergamon.

    Krashen, S. (1982).Principlesandpracticeinsecondlanguageacquisition. Oxford: Pergamon.

    Krashen, S. (1994). The input hypothesis and its rivals. In N. C. Ellis (Ed.),Implicitandexplicitlearningoflanguages(pp. 45-77). San Diego: Academic Press.

    Loewen, S. (2009). Grammaticality Judgment Tests and the mesuresment of implicit and explicit L2 knowledge. In R. Ellis, S. Loewen, C. Elder, R. Erlam, J. Philp & H. Reinders (Eds.),Implicitandexplicitknowledgeinsecondlanguagelearning,testingandteaching(pp. 94-112). Bristol: Multilingual Matters.

    Mandell, P. B. (1999). On the reliability of grammaticality judgement tests in second language acquisition research.SecondLanguageResearch, 15(1), 73-99.

    Masny, D. (1987). The role of language and cognition in second language metalinguistic awareness. In J. Lantolf & A. Labarca (Eds.),Researchinsecondlanguagelearning:Focusontheclassroom(pp. 59-73). Norwood: Ablex.Murphy, V. (1997). The effect of modality on a grammaticality judgement task.SecondLanguageResearch, 13(1), 34-65.

    Norris, J. M., & Ortega, L. (2000). Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis.LanguageLearning, 50, 417-528.

    Paradis, M. (1994). Neurolinguistic aspects of implicit and explicit memory: Implications for bilingualism and SLA. In N. C. Ellis (Ed.),Implicitandexplicitlearningoflanguages(pp. 393-419). San Diego: Academic Press.

    Schmidt, R. (1994). Deconstructing consciousness in search of useful definitions for applied linguistics.AILAReview, 11, 11-26.

    Searle, J. R. (2000). Consciousness.AnnualReviewofNeuroscience, 23, 557-578.

    Sorace, A. (1985). Metalinguistic knowledge and language use in acquisition-poor environments.AppliedLinguistics, 6(3), 239-254.

    Stevens, J. P. (2007).Intermediatestatistics:Amodernapproach. New York: Lawrence Erlbaum Associates.

    Tokowicz, N., & MacWhinney, B. (2005). Implicit and explicit measures of sensitivity to violations in second language grammar: An event-related potential investigation.StudiesinSecondLanguageAcquisition, 27(2), 173-204.

    Whong-Barr, M., & Schwartz, B. D. (2002). Morphological and syntactic transfer in child L2 acquisition of the English dative alternation.StudiesinSecondLanguageAcquisition, 24, 579-616.

    10.3969/j.issn.1674-8921.2014.12.004

    Correspondence should be addressed to Man Li, Second Language Acquisition, 3215 Jiménez Hall, University of Maryland, College Park, MD 20742, USA. Email: manli@umd.edu

    蜜桃久久精品国产亚洲av| 一区二区三区国产精品乱码| 国产精品电影一区二区三区| 国产亚洲精品av在线| 婷婷精品国产亚洲av| 亚洲精品在线观看二区| 亚洲激情在线av| 国产伦人伦偷精品视频| 精品久久蜜臀av无| 国产精品电影一区二区三区| 欧美+亚洲+日韩+国产| 88av欧美| 99riav亚洲国产免费| 成熟少妇高潮喷水视频| 亚洲av五月六月丁香网| 国产一区二区在线观看日韩 | 每晚都被弄得嗷嗷叫到高潮| 国产又色又爽无遮挡免费看| 日韩欧美免费精品| 两人在一起打扑克的视频| 一级毛片精品| 亚洲av成人不卡在线观看播放网| 亚洲av日韩精品久久久久久密| 91国产中文字幕| 精品久久久久久久久久久久久| 欧美日韩瑟瑟在线播放| 亚洲乱码一区二区免费版| 国产精品久久久人人做人人爽| 在线永久观看黄色视频| 国产欧美日韩一区二区三| 亚洲熟妇熟女久久| 久久久水蜜桃国产精品网| 变态另类丝袜制服| 老汉色av国产亚洲站长工具| 琪琪午夜伦伦电影理论片6080| 黄色视频,在线免费观看| 91成年电影在线观看| 亚洲九九香蕉| 国产高清有码在线观看视频 | av视频在线观看入口| 性色av乱码一区二区三区2| 亚洲精华国产精华精| 亚洲五月天丁香| 嫁个100分男人电影在线观看| 一本久久中文字幕| 精品久久蜜臀av无| 岛国在线观看网站| 国产精品久久久久久精品电影| 狠狠狠狠99中文字幕| 欧美3d第一页| 亚洲一区中文字幕在线| 国产精品久久久人人做人人爽| a级毛片在线看网站| 午夜福利成人在线免费观看| 一级黄色大片毛片| 五月玫瑰六月丁香| 免费在线观看黄色视频的| 人妻丰满熟妇av一区二区三区| 夜夜看夜夜爽夜夜摸| 在线永久观看黄色视频| 日韩高清综合在线| 啦啦啦观看免费观看视频高清| 精品一区二区三区视频在线观看免费| 国产一区二区在线av高清观看| 真人一进一出gif抽搐免费| 黑人欧美特级aaaaaa片| 中文亚洲av片在线观看爽| 他把我摸到了高潮在线观看| 真人一进一出gif抽搐免费| 高潮久久久久久久久久久不卡| 国产午夜福利久久久久久| 在线免费观看的www视频| 又大又爽又粗| 99热这里只有是精品50| 精品人妻1区二区| or卡值多少钱| 欧美日韩亚洲国产一区二区在线观看| 国产亚洲av高清不卡| 久久精品国产清高在天天线| 最近在线观看免费完整版| 亚洲在线自拍视频| 999久久久精品免费观看国产| 精品乱码久久久久久99久播| 国产精品美女特级片免费视频播放器 | 国产欧美日韩一区二区精品| 9191精品国产免费久久| 国产一区二区在线观看日韩 | 中文字幕人成人乱码亚洲影| 桃红色精品国产亚洲av| 亚洲精品av麻豆狂野| 国产爱豆传媒在线观看 | 国内精品一区二区在线观看| 少妇被粗大的猛进出69影院| 1024手机看黄色片| 欧美乱码精品一区二区三区| 欧美日本亚洲视频在线播放| av视频在线观看入口| 美女扒开内裤让男人捅视频| 亚洲精品在线美女| 久久久精品欧美日韩精品| 亚洲成a人片在线一区二区| 欧美高清成人免费视频www| 女人高潮潮喷娇喘18禁视频| 色精品久久人妻99蜜桃| 黄色a级毛片大全视频| 久久婷婷成人综合色麻豆| 国产精品日韩av在线免费观看| 夜夜爽天天搞| 午夜福利成人在线免费观看| 在线a可以看的网站| 草草在线视频免费看| 久久久久久大精品| 后天国语完整版免费观看| 国产aⅴ精品一区二区三区波| 国产精品野战在线观看| 亚洲自拍偷在线| 久久精品国产亚洲av高清一级| 亚洲在线自拍视频| 久久精品人妻少妇| 国产亚洲精品久久久久5区| 精品欧美一区二区三区在线| 全区人妻精品视频| 变态另类丝袜制服| 欧美中文日本在线观看视频| 麻豆成人av在线观看| 美女黄网站色视频| 97超级碰碰碰精品色视频在线观看| 国产亚洲精品av在线| 国产在线观看jvid| 99久久无色码亚洲精品果冻| 精品国内亚洲2022精品成人| 精品久久久久久,| 欧美在线一区亚洲| 免费在线观看日本一区| 亚洲国产精品sss在线观看| 岛国在线免费视频观看| 久久热在线av| 免费看a级黄色片| 亚洲精品中文字幕一二三四区| 美女扒开内裤让男人捅视频| 老熟妇仑乱视频hdxx| 99国产综合亚洲精品| 欧美另类亚洲清纯唯美| 国产精品综合久久久久久久免费| 亚洲精品中文字幕一二三四区| 日本三级黄在线观看| 精品国产超薄肉色丝袜足j| 国产三级黄色录像| 欧美极品一区二区三区四区| 国产视频一区二区在线看| 免费高清视频大片| 首页视频小说图片口味搜索| 熟女电影av网| 老汉色av国产亚洲站长工具| 精品欧美一区二区三区在线| 人妻夜夜爽99麻豆av| 淫秽高清视频在线观看| 欧洲精品卡2卡3卡4卡5卡区| 欧美一区二区精品小视频在线| 精品国产乱码久久久久久男人| 欧美另类亚洲清纯唯美| 成人国产一区最新在线观看| 夜夜爽天天搞| 亚洲中文日韩欧美视频| 久久天堂一区二区三区四区| av片东京热男人的天堂| 久久香蕉精品热| 日韩三级视频一区二区三区| 国产成人啪精品午夜网站| 麻豆久久精品国产亚洲av| 亚洲人成77777在线视频| 人妻久久中文字幕网| 女同久久另类99精品国产91| 日韩欧美免费精品| 欧美中文日本在线观看视频| 国产熟女xx| 国产一级毛片七仙女欲春2| 亚洲成人精品中文字幕电影| 听说在线观看完整版免费高清| 三级毛片av免费| 欧美最黄视频在线播放免费| 亚洲一区中文字幕在线| 又紧又爽又黄一区二区| 亚洲人成网站在线播放欧美日韩| av片东京热男人的天堂| 欧美国产日韩亚洲一区| 欧美精品亚洲一区二区| 日韩免费av在线播放| 久久婷婷人人爽人人干人人爱| 欧美黄色片欧美黄色片| 成年人黄色毛片网站| 啦啦啦观看免费观看视频高清| 国产一区二区三区视频了| 国产蜜桃级精品一区二区三区| 男女视频在线观看网站免费 | 搞女人的毛片| 999久久久精品免费观看国产| 日本精品一区二区三区蜜桃| 黄片大片在线免费观看| 精品一区二区三区av网在线观看| 亚洲成人免费电影在线观看| avwww免费| 丝袜美腿诱惑在线| 久久香蕉激情| 黄色毛片三级朝国网站| 天天躁夜夜躁狠狠躁躁| 九色成人免费人妻av| 又大又爽又粗| 一级毛片女人18水好多| 两个人的视频大全免费| АⅤ资源中文在线天堂| 在线观看免费午夜福利视频| 中文在线观看免费www的网站 | 老汉色av国产亚洲站长工具| 俺也久久电影网| 成人三级做爰电影| 亚洲av片天天在线观看| 精品人妻1区二区| 久久久国产精品麻豆| 中文字幕精品亚洲无线码一区| 国产成人精品久久二区二区免费| 波多野结衣高清无吗| 少妇裸体淫交视频免费看高清 | 搞女人的毛片| 亚洲自拍偷在线| 色综合站精品国产| 高清毛片免费观看视频网站| 在线播放国产精品三级| 国产黄片美女视频| 国产av一区二区精品久久| 人成视频在线观看免费观看| 熟女少妇亚洲综合色aaa.| 久久久久国产一级毛片高清牌| 国产伦一二天堂av在线观看| 免费看a级黄色片| 九九热线精品视视频播放| 久久久国产成人免费| 日本一本二区三区精品| 老熟妇仑乱视频hdxx| 亚洲精品国产精品久久久不卡| 桃红色精品国产亚洲av| 狂野欧美白嫩少妇大欣赏| 亚洲 欧美一区二区三区| 91字幕亚洲| 90打野战视频偷拍视频| 久久这里只有精品19| 中文字幕高清在线视频| 变态另类成人亚洲欧美熟女| 久久精品夜夜夜夜夜久久蜜豆 | 首页视频小说图片口味搜索| 在线国产一区二区在线| 亚洲av成人不卡在线观看播放网| 亚洲男人天堂网一区| 日本免费a在线| x7x7x7水蜜桃| 欧美乱色亚洲激情| 亚洲欧美日韩无卡精品| 亚洲av第一区精品v没综合| 国产v大片淫在线免费观看| 香蕉久久夜色| 午夜影院日韩av| 久久中文字幕人妻熟女| 女人被狂操c到高潮| 两性午夜刺激爽爽歪歪视频在线观看 | 午夜福利欧美成人| 欧美一区二区国产精品久久精品 | 黄色毛片三级朝国网站| 成人特级黄色片久久久久久久| 最近视频中文字幕2019在线8| 国产片内射在线| 女人高潮潮喷娇喘18禁视频| 免费在线观看黄色视频的| 国产视频一区二区在线看| 香蕉丝袜av| 国产精品野战在线观看| 99精品欧美一区二区三区四区| 久久久久国产一级毛片高清牌| 91字幕亚洲| 18禁裸乳无遮挡免费网站照片| 亚洲欧美日韩东京热| www.999成人在线观看| 人妻久久中文字幕网| 又粗又爽又猛毛片免费看| 色精品久久人妻99蜜桃| 精品福利观看| 久久中文字幕人妻熟女| 免费观看精品视频网站| 午夜免费观看网址| 亚洲精品国产一区二区精华液| 精品电影一区二区在线| 国产精华一区二区三区| 久久香蕉精品热| 性色av乱码一区二区三区2| 日韩大尺度精品在线看网址| 色综合亚洲欧美另类图片| 欧美黄色淫秽网站| 国产三级在线视频| 日韩有码中文字幕| 亚洲电影在线观看av| 99国产精品一区二区蜜桃av| 超碰成人久久| 极品教师在线免费播放| 日韩大尺度精品在线看网址| 国产精品一区二区三区四区久久| 天堂影院成人在线观看| 少妇被粗大的猛进出69影院| 精品久久久久久成人av| 亚洲国产看品久久| 国产视频内射| 波多野结衣高清无吗| 在线观看免费日韩欧美大片| 欧美日韩瑟瑟在线播放| 少妇裸体淫交视频免费看高清 | 国产成人系列免费观看| 国产97色在线日韩免费| 男人舔女人的私密视频| 18禁黄网站禁片午夜丰满| 熟女电影av网| 午夜福利视频1000在线观看| 国产乱人伦免费视频| 91av网站免费观看| 在线观看舔阴道视频| 国产一区二区激情短视频| 91大片在线观看| 男人舔女人下体高潮全视频| 99热这里只有精品一区 | 久久这里只有精品中国| 精品欧美一区二区三区在线| www日本黄色视频网| 很黄的视频免费| 每晚都被弄得嗷嗷叫到高潮| 麻豆成人午夜福利视频| 国产一级毛片七仙女欲春2| 日韩大码丰满熟妇| 欧美精品亚洲一区二区| 国产精品久久视频播放| av福利片在线观看| 中国美女看黄片| 久久久久国产精品人妻aⅴ院| 久久中文字幕一级| 亚洲av成人一区二区三| 久久久久久国产a免费观看| 91老司机精品| 国产精品免费一区二区三区在线| 欧美国产日韩亚洲一区| 色综合亚洲欧美另类图片| 又爽又黄无遮挡网站| 波多野结衣高清无吗| 成人av在线播放网站| 身体一侧抽搐| 国产欧美日韩一区二区精品| 久久久久久人人人人人| 在线观看日韩欧美| 亚洲 国产 在线| 国产熟女午夜一区二区三区| 国产爱豆传媒在线观看 | 村上凉子中文字幕在线| 老司机午夜十八禁免费视频| 午夜福利在线在线| 欧美色欧美亚洲另类二区| 国产爱豆传媒在线观看 | 国产精品久久久av美女十八| 老司机午夜福利在线观看视频| 最好的美女福利视频网| 久久久国产成人精品二区| 日韩欧美国产一区二区入口| 日本撒尿小便嘘嘘汇集6| 欧美+亚洲+日韩+国产| 女警被强在线播放| 欧美+亚洲+日韩+国产| 无人区码免费观看不卡| 国产三级中文精品| av片东京热男人的天堂| 日韩欧美精品v在线| 国产97色在线日韩免费| 精品久久久久久,| 成年女人毛片免费观看观看9| 午夜免费成人在线视频| 免费看日本二区| 日本五十路高清| 国产成人av教育| 久久久久久九九精品二区国产 | 国产精品久久久av美女十八| 欧美丝袜亚洲另类 | 哪里可以看免费的av片| 日日摸夜夜添夜夜添小说| 国产午夜精品久久久久久| 淫妇啪啪啪对白视频| 99热只有精品国产| 人妻丰满熟妇av一区二区三区| 国产欧美日韩精品亚洲av| 欧美一级a爱片免费观看看 | 少妇熟女aⅴ在线视频| 精品国产乱码久久久久久男人| 女人爽到高潮嗷嗷叫在线视频| 国产精品自产拍在线观看55亚洲| 国产伦一二天堂av在线观看| cao死你这个sao货| 国产精品一区二区精品视频观看| 又大又爽又粗| 黄色 视频免费看| 成年人黄色毛片网站| 两个人的视频大全免费| 99精品久久久久人妻精品| 18禁观看日本| 免费在线观看黄色视频的| 此物有八面人人有两片| 国产区一区二久久| 午夜福利欧美成人| 久久久国产成人精品二区| 18禁观看日本| 后天国语完整版免费观看| 亚洲欧美日韩东京热| 深夜精品福利| 国产精品美女特级片免费视频播放器 | 日本黄大片高清| 精品国产乱码久久久久久男人| 一区二区三区国产精品乱码| 丰满的人妻完整版| 亚洲一卡2卡3卡4卡5卡精品中文| 白带黄色成豆腐渣| 视频区欧美日本亚洲| 亚洲国产中文字幕在线视频| 又粗又爽又猛毛片免费看| www.www免费av| 女人爽到高潮嗷嗷叫在线视频| 久久99热这里只有精品18| 国产精品美女特级片免费视频播放器 | 亚洲成人久久爱视频| 亚洲av五月六月丁香网| 天天添夜夜摸| 99热这里只有是精品50| 午夜福利欧美成人| 亚洲成人久久爱视频| 在线观看66精品国产| 欧美高清成人免费视频www| 看黄色毛片网站| 这个男人来自地球电影免费观看| 亚洲va日本ⅴa欧美va伊人久久| 久久久国产精品麻豆| 男男h啪啪无遮挡| 国产一区二区在线av高清观看| 国产成人影院久久av| 手机成人av网站| 一夜夜www| 亚洲国产日韩欧美精品在线观看 | 久久久久久大精品| 成人欧美大片| 欧美又色又爽又黄视频| 高清毛片免费观看视频网站| 天堂av国产一区二区熟女人妻 | 日韩av在线大香蕉| 人人妻人人看人人澡| 国产免费av片在线观看野外av| 又大又爽又粗| 免费无遮挡裸体视频| 色播亚洲综合网| 不卡av一区二区三区| 嫩草影院精品99| 高潮久久久久久久久久久不卡| 国产精品免费一区二区三区在线| x7x7x7水蜜桃| 国产精品国产高清国产av| 天堂动漫精品| 国产在线精品亚洲第一网站| avwww免费| 成人国语在线视频| 女人高潮潮喷娇喘18禁视频| 久9热在线精品视频| 亚洲人成网站在线播放欧美日韩| 国产精品香港三级国产av潘金莲| 亚洲国产欧美人成| 可以在线观看毛片的网站| 丰满人妻一区二区三区视频av | 夜夜看夜夜爽夜夜摸| 麻豆av在线久日| 日韩精品中文字幕看吧| 我要搜黄色片| 亚洲午夜理论影院| 亚洲无线在线观看| 天堂av国产一区二区熟女人妻 | 别揉我奶头~嗯~啊~动态视频| 国产午夜福利久久久久久| 禁无遮挡网站| 国产精品99久久99久久久不卡| 狠狠狠狠99中文字幕| 99精品在免费线老司机午夜| 免费在线观看完整版高清| 欧美国产日韩亚洲一区| 久久精品夜夜夜夜夜久久蜜豆 | 搞女人的毛片| 国内毛片毛片毛片毛片毛片| 99国产精品99久久久久| 久久久久久大精品| 人人妻人人看人人澡| 国产精品自产拍在线观看55亚洲| 男女那种视频在线观看| 男女做爰动态图高潮gif福利片| 亚洲欧美精品综合久久99| 国产精品影院久久| 欧美日韩福利视频一区二区| 国产精品免费视频内射| 狠狠狠狠99中文字幕| 老司机深夜福利视频在线观看| 久久香蕉国产精品| 日日摸夜夜添夜夜添小说| 亚洲精品国产精品久久久不卡| 成人一区二区视频在线观看| 国产精品久久久久久精品电影| 法律面前人人平等表现在哪些方面| 国产成人系列免费观看| 一本一本综合久久| 搡老熟女国产l中国老女人| 黄色视频,在线免费观看| 欧美另类亚洲清纯唯美| 欧美日韩瑟瑟在线播放| 亚洲欧美一区二区三区黑人| 亚洲人成网站高清观看| 久久99热这里只有精品18| svipshipincom国产片| 男人舔奶头视频| 女警被强在线播放| 又粗又爽又猛毛片免费看| 国产精品美女特级片免费视频播放器 | 亚洲欧洲精品一区二区精品久久久| 成人av一区二区三区在线看| 一级作爱视频免费观看| 国产一区二区三区视频了| 久久久国产成人免费| 亚洲中文字幕一区二区三区有码在线看 | 美女高潮喷水抽搐中文字幕| 中文在线观看免费www的网站 | svipshipincom国产片| 免费av毛片视频| 精品久久久久久久久久久久久| 国产免费av片在线观看野外av| 91大片在线观看| 90打野战视频偷拍视频| 成年版毛片免费区| 久久香蕉激情| av欧美777| 成人一区二区视频在线观看| 男女之事视频高清在线观看| 身体一侧抽搐| 老司机午夜福利在线观看视频| 亚洲18禁久久av| 国产成+人综合+亚洲专区| 嫁个100分男人电影在线观看| 午夜福利在线在线| 最新美女视频免费是黄的| 亚洲国产欧美人成| 亚洲最大成人中文| 欧美日韩福利视频一区二区| 久久久国产欧美日韩av| 最新美女视频免费是黄的| 国产一区二区三区在线臀色熟女| 又紧又爽又黄一区二区| 亚洲人成伊人成综合网2020| 又粗又爽又猛毛片免费看| 亚洲国产中文字幕在线视频| videosex国产| 亚洲专区国产一区二区| 两人在一起打扑克的视频| 99热只有精品国产| 一本综合久久免费| 国产欧美日韩一区二区精品| 亚洲成人中文字幕在线播放| 日日爽夜夜爽网站| 亚洲五月天丁香| 男人舔奶头视频| 制服人妻中文乱码| 91成年电影在线观看| 欧美成人午夜精品| www国产在线视频色| 国产高清视频在线观看网站| 757午夜福利合集在线观看| 国产av又大| av欧美777| 亚洲午夜理论影院| 18禁裸乳无遮挡免费网站照片| 久久久国产欧美日韩av| 国产成人av激情在线播放| 国产精品av久久久久免费| 在线观看免费视频日本深夜| 又爽又黄无遮挡网站| 床上黄色一级片| 国产乱人伦免费视频| 日本撒尿小便嘘嘘汇集6| 久久中文看片网| 成人高潮视频无遮挡免费网站| 国产成人aa在线观看| 国产蜜桃级精品一区二区三区| 国产午夜精品论理片| 国产成人影院久久av| 国产精品久久久av美女十八| 亚洲精品av麻豆狂野| 男女之事视频高清在线观看| 午夜福利高清视频| 久久伊人香网站| 俄罗斯特黄特色一大片| 精品国产超薄肉色丝袜足j| 成人亚洲精品av一区二区| 精品乱码久久久久久99久播| 一区二区三区国产精品乱码| 国产精品精品国产色婷婷| 国产亚洲欧美98| 岛国在线观看网站| 99riav亚洲国产免费| 欧美三级亚洲精品| 久9热在线精品视频| 国产精品久久久久久亚洲av鲁大| 国产精品亚洲av一区麻豆| 97人妻精品一区二区三区麻豆| 国产精品 欧美亚洲| 亚洲18禁久久av|