(Sébastien) Intro start to -> 2:18 (Daphne Koller) 2:19 -> 33:34 (Eli Bindner) Great, thanks so much, Daphne, and then again, just to remind everyone here, so now I will spend some time talking more specifically about the GTC and ....... But thanks again for having been with us. (Koller) Thank you. (Bindner) Just a reminder: if you see questions that are being asked on the ...... (check 33:50) and you're really in ........ (check) boost them up so the come to our attention. And - let's take a quick look at any questions have been asked already. So, I see that there is a great question here about translation quality. Sébastien, do you want to talk a little about what we're thinking about ensuring translation quality in the GTC and what kind of procedure ...... (check) on place? (Sébastien) Sure. So, the way we tried to continually up quality of translations from GTC is to have sort of a tutoring system for, you know, as individual act volunteers (check) we rely on you just sort of submit the translations and let us know what you think would be the best translation but obviously, there is a lot of range of opinions and a lot of different ways you can translate something. And so, I think it's always important to have at least one person per language to sort of be that voice and have the final say in deciding, this is how we want to present translations of our content in this language. And so, in this capacity, we have a specific role, it's the language coordinator. Not all languages have this at the moment. As we scale up the program and learn from the particular needs of each community, we intend to fill those spots where we can, strategically and give that person the responsibility of deciding the directions for the language and also having the daily task of reviewing translations on Transifex, to make sure that everything is always correct, but also in line with what they sort of want to project (check), like when we have that translated content shown to our international users. (35:56) (Bindner) Thanks, Sébastien. I wanted to talk a little bit -- there's a question here from .... (check) about when language coordinators will be chosen. So, as Sébastien mentioned, ....... (check) is being totally thrilled and overwhelmed, frankly, with response to the GTC and are really grateful to everyone. Part of the challenge for us, now, is that we're a tiny team here ...... (check 36:23) and we're trying to kind of enable this program and channel the great work that everyone here is doing. So, as part of that, we're working a little bit more slowly than I think we would have liked. But as a first step, we really wanted to bring everyone onto this internal translation portal, these GTC Headquarters, and also give everyone the possibility to just kind of jump into things. And as Sébastien mentioned, we sort of have this tutorate system where we work with partners in certain languages and then, for other languages where we don't have partners yet, although ....... (check) might very well in the future, it's a little bit more ....... (check) now. But part of the structure that we will be building into these currently unpartnered languages is by bringing in language partners. So we've been thrilled to see a lot of interest from all around in serving as language coordinators. And over the next week or two, we'll be looking through these applications and working out procedures to ...... (check) language coordinators. An idea is that right now, things are very unstructured. If you -- you know, you just have a list of courses, you can jump in and translate, there's no one for unpartnered languages to really review The idea is we'll be building out (check) a lot more structure around that and within... structures.... - we've seen it be really effective in our Portuguese and Chinese language communities that work on team model, where there are team leaders and they help recruit a team and at the end, when the course is finished, the team leaders help review the content and then you can ensure really high-quality translation, while also creating a really good experience for everyone participating. So, that's one model that's worked really well and we hope to bring some of that into our currently unpartnered languages too. So again, thank you for your patience in these initital days and couple of weeks and over the next week (check) we'll be digging much more into the currently unpartnered languages to help create a more structured and smoother experience around those. Amazingly -- this is a final note and sorry to talk so much -- you know, we've been totally overwhelmed by how -- even for these languages where there hasn't been a lot of structure -- how busy ....... (check) and how a lot of you are creating structure in the ...... (check) structure. So, really, really impressed and grateful for that, and we're hoping to help a little bit more on our .... weeks (38:50) (Sébastien) Yes, and I also want to mention that, you know, as we sort of are getting over this, sic, initial -- I guess I'll catch up in trying to get everyone into the community and get started -- we're freeing up more time to sort of engage with you directly. I think it's, you know, I think the beauty of -- ....... (check) like you said, Eli -- of crowdsourcing is the fact that, like, we all have different skills and different interests and, you know, different amounts of time that we're able to contribute. And, you know, [to match check], I look at it as our job to figure out how to best enable everyone to work the way that they want to work together, and complement those skills. So, that's sort of the philosophy behind the way that we are approaching building up this structure of the translation (check) programs. The other aspect, though, is community, which I feel like is the primary focus. And, you know, as we have more bandwidth (check) to sort of personally engage with you, either through forms or emails, you know, I can see this consistently like this is a learning experience for a lot of us, you know, and you know, I -- as the people on the ground, like I want to hear, you know, your feedback and your ideas, like, you know, like Eli mentioned that some people are creating structures on their own and that is stuff that should be shared with us, you know, so that we can, you know, learn from how you guys best work and what we can promote to other people and evolve, so that we take the best of what's happening within the community and make the entire community better. (40:37) (Bindner) Thanks, Sébastien. There's a question here, asked from Luis (check) "Are you going to offer some consultation for translators?" I'm not -- I hope I'm answering this as you intended but I think the question is, "What kind of recognition does Coursera provide for people that are participating in this program?" And as we tried to mention in different areas in the forums and emails, we really want to recognize the amazing work that's going on in the community and so we're doing a number of things for that. So one is, once you translate, once a member of the GTC translates a certain threshold, a certain amount of content, they will be recognized on our public site and we think that this is hopefully a nice way to recognize people putting in time and energy by recognizing them on our public site on coursera.org/about/meetourtranslators -- I think that's the URL but we'll make sure that it's clear in our GTC headquarters -- and that's one way. Another way is by offering certificates. I know there is another question about, will Coursera have some formal recognition for translators, and so, for translators who have participated at a certain level, you'll receive a statement of accomplishment, just like one for a course, and that's something that we're also open to ............ (check) including, but as a start, that's just one form of recognition that we want to give, for -- you know, we -- once we have a little bit more structure, particularly for languages that are currently unpartnered, it'll be easier for us to introduce some of these reward systems so one thing that we're doing both in the Chinese and Portuguese communities now, where we have a little bit more structure, is that we are offering team leaders, so, people who are ...... (check) effort and pouring a lot of energy into translation, get a free signature track, and that's something that will continue and then we want to do all sorts of small things too. I'm sure I'm missing things, l -- let's have a peak on our Global Translator Community Headquarters and go through this stuff in detail, so I recommend .... (check) check that out But we want to do a lot of small things too, for instance this sort of hangout, which is only open to you GTC members, other special events, you know, one thing we've done in the past, are bringing in professors of courses to do hangouts on air like this, facilitating regional meetups of translators, maybe providing some, you know, financial support to make those kinds of regional meetups possible. And I think there are tons of ways that we can help recognize the work that is going on in the community. And I think at the end of the day, Sébastien -- ............ (check) community supportive of the people who are involved in it -- so, this is really important to us and we really, we welcome your feedback and any ideas that you have. So hopefully, that answers your question, Luis, and yes, I know that lots of other people are interested in that as well. (43:42) Let's take a look at some of these other questions here. So, a good question about choosing courses. Sébastien, do you want to talk a little bit about how, you know, how we might allow volunteers to help choose the courses that we're working on? (Sébastien) Errh, totally. So just some background about -- some insight into how we choose the courses that we currently translate, because I realize that's, like, a little bit "black box" at the moment. We work with either partners in different countries, like you already mentioned, or using analytics data to just sort of understand the needs of various populations and ................... (check) appropriateness of courses and that's sort of like the primary driver of how we decide that we want to translate a course. And then, even before that happens, a lot of -- course instructors, you know, they are ultimately the ones that can -- well, we work with course instructors to enable courses for tranlation, right? And so, in order to make sure that translation work is not, I want to say (check), like, wasted, but we work with course instructors to make sure that their course content is stable, as in, like, it will be reused in the future and that won't change significantly, so that, like, the translation work that you guys will put in won't be just eliminated if they just decide to change individual modules. And so, there's sort of a discussion process here about, like, selecting the courses and making sure that they are appropriate for translation. And then, to get to your specific question, I think that having a feedback module for community members to tell us what they want to see translated is really important and something that is on our, like, near-future road map. I don't know if it will be like a Google form, or something in the forums, but I think it's really important to collect that kind of -- those requests from people who actually are the people who would be most interested in taking those courses. And so, good idea, something we've already thought about and hope to implement soon. (45:16) (Bindner) Thanks, Sébastien. A really fundamental and important question from Tasia. Tasia asks: "I'm not sure how to get started. Do we get assigned to a project or do we choose one? What should we do. Thanks." Thank you, Tasia. So, right -- so, basically, this is how it works: so, you're part of the GTC community, you're part -- you've access to this private translators' portal, the Global Translator Community Headquarters. And once you come on the Headquarters, there are different features for each language community. And the pages explain how to get started within that language community and each language community will be a little bit different. That's part of, you know, in designing the program we wanted maintain flexibility. So, for instance, if you want to join the Chinese language community, .......... Chinese speaker (check) we work with a partner, a wonderful partner, Guokr, in China and so, you go to the page Guokr explains how to join the Guokr program. Our Portuguese community, which is managed by Tatiana, I don't know if Tatiana is here, but thank you for all the amazing work you're doing, our friends of the Lemann Foundation in Brazil. This is a pretty important (check) Portuguese community. There is a page for that, you go to that page, and then you can apply to work on a particular program. So they work on it, a team-based model (47:39) Right now, as I mentioned before, besides Portuguese and Chinese and Russian -- I'm sorry, so Russian ..... our friends at ABBYY -- have a system where you go to a different platform outside Coursera and it's a kind of crowdsourcing model, so you can add a sentence, or upload or download existent translations, a really really wonderful platform and their page on the Coursera Translator Headquarters explains how to get started on that. So, if you're not from one of those communities right now, we have pages, our page for Other Languages and Spanish, which is also ..... a little bit more ...... (check 48:17) and again, we'll be building instructions to that by this language coordinators mechanism. So once language coordinators come onboard, there'll be more structure in these communities as well. But for now, you should feel free to jump in to Transifex, which is our main translation platform, and just start working on translations. And we realize that there are going to be inconsistencies in the courses, that these courses need to be reviewed, but very quickly, we will get a language coordinator system moving, and a reviewer system in place and so, things will be better on that part (check 48:54) It's not (check) a summary of how you should get started translating. (Sébastien) And it's also worth mentioning that we've listed a few projects that represent some of those most popular courses on Coursera under that Other Languages tab, and so, even if you want, like, more -- if you just want to dive in and like, choose a course out of the vast number of courses that we are offering for translation, then that's also a good starting point. (49:24) (Bindner) Thanks. There is a good question here about native language course transcripts. By the way, another housekeeping note: I see it's already 8:50 a.m. PST, so, Sébastien and I will chat for another 10 minutes. There are definitely questions we are not going to get to, but we'll go through the questions and we'll make sure that other questions that are, you know, that need to be answered, are answered in the discussion forums of the GTC portal. We'll do this again, I think it is a great mechanism for sharing information with our community (check 14:56) Thanks again to everyone for being here. That said, let's take a couple of questions. So about the English language transcripts: so how it works right now is when a -- so Coursera is a platform. Our university partners use the platform and when they create content on the platform, when they add videos to the platform, they can request captions, native-language captioning for those videos (check). When they request captioning, that goes to a company that we work with, that does human language-captioning of videos. So then people listen to the videos and actually, humans write out the words that are being spoken on the screens. Now, the people who are doing these captions, they are not subject-matter experts, so, for instance in the course on Machine Learning, you know, they're probably going to get some words wrong, there are going to be grammatical mistakes and, you know, one of the challenges that I realize, that we certainly realize as a challenge, is that English transcripts are not perfect. And we think that they've improved a lot, we've worked with this provider that we use to improve that. I don't know if any, if actually some of you had been on the platform for a couple of years and saw the transcripts back in 2012, and maybe you can tell that they have gone better -- I hope so. But one thing that we'd really love to do in the future is that native English speakers participate in this translation program as well and work on correcting the English language transcription, verifying that as corrected (check 51:19) This is somewhat difficult technically and we don't really have an infrastructure for it -- infrastructure or a program for it right now, but I think it's a great idea, it's something that we'd love to do, because we realize that as Aurelia (check) says, it does make translation harder, because you have to consult the videos as you're going through the transcripts. So, thanks for the question. Definitely agreeing and would love to -- and we're planning on working on it in the future (51:47) Alright. Other questions. Sorry, looking through the great questions here. Sébastien, one for you: "Is there any Coursera-approved instruction on tech details of translating subtitles, such as, what is the longest line that would fit into a screen? Other kinds of technical details about using the platform, or maybe kind of translation best practices? (Sébastien) Ehm, yeah, I mean, as like, I think I can, like, if you just follow sort of the -- like general translation best practices, they should cover almost any issues that ..... (check 52:32) I think one will be working with something as, I want to say like a rigid format like subtitles, you know, there's not a lot of margin for errors. So the advice that I would give for translating is that, you know, first and foremost, like, you know, consider the semantic meaning of the text that you're translating. So, if you are in Transifex and you see the subtitles, you'll see that they're grouped by sort of lines, where it, like, the screen, the individual sentences that will come up at a time, and a lot of people sort of, like, fall into this trap of like, "Oh I need to, like, format my translations in, like, exact same line breaks" or like, where, like, the English sentence, like, starts on a new line and I would say, don't give yourself a headache like doing that, you know, I've seen like a lot of trans-- innovative (check) translators, like, take source text and translate it into for example Russian, and they will rearrange the sentences so it makes more sense in Russian. And so, feel free to do that if you feel, like, that is what is valuable for you as a native speaker. In terms of length, I would also try -- that's kind of the one concern I would advise for, like try to stick within, or under the length of the subtitles, because subtitles, if you go on too long, it can affect (check: "enact"????) the readability and so, always err on sort of shorter translations and use the source text as your bar to measure against. And then, you know, as I've been sort of explaining through Transifex when people submit a translation, I try to keep a list of sort of these, like, issues where that came from, I haven't noticed very many so far, but if you do have questions, feel free to sort of write. I can even actually start a sort of, like a Translation Best Practices forum within our GTC. just keep that discussion going and collect your feedback and, you know, hope you guys will start (check) the daily questions you might have about the work that you do. (5:47) (Bindner) Thanks, Sébastien. Another question here from Hunadahs [sic, actually Yuki Ame], about promoting courses. So, you know, the Translation Community translates a course, the course is now available in another language. Anyhow, does this work? (check) And b) how do students on Coursera know that that course is now available in this other language? So, Sébastien, do you want to field that one, so how does, how do your courses get from the translation platform to the Coursera class site? And then, how do students on the class site know that these courses are now available in a new language? (Sébastien Kuo) Sure. So, once a course's content is both complete and reviewed, which are two separate sets on Transifex, we actually have an automated script that sort of checks for these two things to be true, and then we'll, you know, import the translated subtitles to that course's class site on Coursera. And so, first and foremost, as, when you visit like the class page that kind of introduces the course information, there'll be a little, like, a module on the right that displays information about the course. And one of those facets is available subtitles. And so you'll see, if there's available subtitles for Chinese and Spanish, then it'll say "English, Chinese and Spanish subtitles." And so, that's ind of the first point where somebody would notice something about that (check) And then also, as it works on YouTube, like while you're watching a video, there'll be a sort of a closed caption / subtitle button and hopefully, you know, people will see that and click it and see that there's the list of, like, available subtitles, and one that may match, like the one that they're trying to look for. We also work with course instructors to sort of have them, like a lot of course instructors, you know, mark it and promote their own courses themselves and so, you know, through our partnership managers and also us, like, we work very closely with them to sort of keep them abreast about translation progress and you know, let them know, like oh, like these language subtitles (check) are available and so they can also promote that to their students outside of Coursera or on Coursera itself through an e-mail or their forums. (57:20) (Eli Bindner) Thanks, Sébastien. So let me just answer a couple more questions very quickly and then wrap things up. So there is a great question about translating the user interface, " Is it possible to translate that with Transifex?" So right now, we work with professional translators to translate our user interface and in the future it's something we'd love to consider opening up to the community as well. You know, part of, I guess -- what we're thinking is that once the community develops and grows, that -- and matures and there is more structure in it -- and that will be the appropriate time to open up the interface. Because obviously, the interface is something that's very visible and, you know, it's really important that the quality is super-high. Right now, we're still working on improving the technical aspects of translating the user interface. It's actually somewhat tricky, when you pull down the text from the interface to a translation form, making sure that there is enough context there to translate it. So, you know, for instance, sole example: you know, someone reported a translation error the other day where it said "There are three days left to register for signature track." And "left" was translated as, in French, as the word meaning, physically left. And, you know, clearly, this is a big problem but on the translation platform, that string "left" was in isolation and was used in two separate locations, so it actually takes a lot of work, technically and programatically to make sure that the interface translations work well and you don't have silly errors like that. So, it's something we'd love to do in future. Thanks for the great question, Leonardo. Another question about: "Currently, most of the translations are English course to other languages," you know, would we consider going the other way around? Great question: the answer is definitely yes. Already, you know, I've seen some amazing things. Our Chinese community has translated Russian and is now working on Russian and French courses, translating them into Chinese or adding Chinese subtitles: totally amazing and we want to introduce other language pairs in the near future. Again: on the road map and and once the community matures a little bit, it's something that we definitely want to do. I would love to work on translating Chinese courses: I teach Chinese [blurred] some amazing Chinese courses on our platform and I'd love to see those available. So, thanks for the great question, Yufan. And-- (Sébastien Kuo) You know, it'd be pretty cool one day for you to lead a Chinese community -- GTC Community --- Google Hangout On Air, because Chinese is really impressive. As a native speaker I can say that. (EB overlaps - incomprehensible) (Bindner) Yes, that would be fun with me and Kuo co-partners. There's another question about Chinese, I think this is a broader question about -- the question is, you know, obviously there are different dialects of Chinese, there's Cantonese, there is, you know, traditional characters and simplified characters, slightly different usages in, say, Taiwan and mainland: how do we deal with that? I think there's a broader question of, you know, there is Brazilian Portuguese and there is European Portuguese, you know, what kind of Spanish are we accepting on the platform? These are all great questions and these are things that we'll kind of need to work out on a case-by-case basis. You know, we'll talk about this more in our forums but, you know, we think that it makes sense to have separate languages for European Portuguese and Brazilian Portuguese, for instance, that it'll just be a clearer and cleaner experience for both students and translators and certainly, there are things that can be done in converting from Simplified Chinese to Traditional Chinese, programmatically, but, you know, that's something that we'll need to consider as well. So, great question from Wah, thank you for asking it, and the answer is that we'll need to work this out on a case-by-case basis. Let's see if there's any really quick questions that we can answer. I think, because we're at 9 o'clock and I want to be respectful of everyone's time, and so I think we should probably wrap this up and again, we'll look through the questions that are outstanding and I'll make sure that any ............. (check) ones are answered in the forums or in other channels. For my part, I just want to thank everyone for being here today. I know it's probably crazy time zones, some of you are turning in at, you know, 11 p.m., and others at 3 a.m., and ......................... (check sometimes (1:01:54) But we're really, really grateful for everyone being here and spending the time with us, asking great questions, and for all your work. Thanks for inviting Daphne and for the rest of the time i'll share with you, Sébastien, are there any final words you wanted to add as well. (Sébastien Kuo) Yeah, I mean, you know, everyday I am super-impressed with the dedication from both Coursera learners and our GTC members. You know, as a person who works in localization, languages has always been my passion, like, since I was a little kid. I would go to public libraries and take out, like phrasebooks, just to sort of, like, look at these weird words and try to understand what they mean. And I think one of the most gratifying things about building a community like this is that, you know, reading through all your responses, especially to that question on the application that says: "Why do I want to translate?"