00:00In these journals, access is free of charge
00:04Now let's focus on today's workshop
00:08Today's workshop is mainly about systematic literature review
00:13However, there are three components to today's session
00:15I divided this two-hour workshop into three major elements
00:19The first step is understanding the basics of systematic literature review: how a literature review is conducted, what the benefits are, and why we consider systematic literature reviews more important than any other type of literature review
00:34The second component is the systematic literature review paper template: how we can write it and how we can easily prepare a systematic literature review paper
00:47So, I'll provide you with the template
00:49So, you can just follow that template and try to write your literature review paper
00:54In each of the sections, I will give you the template and try to create some examples for you as well
01:02I'll provide these examples so you can use them for your work, and we can write this systematic literature review paper more easily
01:13Finally, we will prepare the final manuscript
01:17These are the three major components of our workshop
01:22Today, I will try to complete all three, but I hope that within two hours I will be able to complete the first two only, and maybe some parts of the first two as well; I may not be able to finish everything today
01:38So, we can have a continuation workshop next time
01:43Let's see how things are going on this week, and then we can move forward
01:45First, the basics of systematic literature review
01:51Once that is done, I will ask you to do some practice, and you can share your ideas in the comment box so we can read them and move forward
02:01Okay, let's start
02:05The outline of this workshop is very simple
02:07First, we will cover the fundamentals of systematic literature review, including what it is and why it is very important
02:15Then, we will look at the typical format of a systematic literature review paper
02:18After that, we will discuss techniques and tools, and I may also give you some tutorials, practices, or exercises that you can follow to conduct your analysis and carry out your review
02:30Your systematic literature review
02:33[snorts] So, you just follow those techniques and steps, and by doing this, you can write at least a basic level systematic literature review paper
02:45Then, we will focus mainly on this workshop following the pattern of research articles published by many reputable publishers and journals
02:56I'll give you some examples as well, and I'll try to create a blog where I will share all this relevant information and the published papers in high-impact-factor journals
03:05Basically, they are on systematic literature reviews
03:10So, you can see those examples, try to follow them, and create your own understanding of systematic reviews
03:20Literature review, and at the end of the day, you can write your own literature review paper and, finally, the publication
03:27We'll also focus on the publication part
03:32So, how can we do publication? We'll try to create a community among the members who are interested in writing meta-analyses and systematic literature reviews
03:42We'll review your work and try to give you some feedback so you can improve it, and it will be ready for publication
03:46Okay
03:51This is how we start
03:56The most important part is why we do systematic literature reviews, why they are very important, and why nowadays many researchers, especially professors, are focusing more on writing systematic reviews
04:13A literature review rather than writing in any other format of papers
04:18Remember, the systematic literature review, irrespective of the area or discipline you are in, or the field of your study, can be done in any field of research
04:30We can focus on systematic literature review, which is why it makes it a very simple and effective writing technique
04:39So, let's see, there are five major reasons why we start with a systematic literature review
04:48Basically, it is used to map the existing knowledge
04:51Initially, it started from medical sciences, where we wanted to see the treatments for a particular disease and the consistency of the treatments across different countries, how they treat that, and what is the..
05:07Results, and then they can find out the optimum solution for any type of disease or cure for any form of disease
05:14But later on, this concept was expanded to all other fields
05:17Now, I think no field is irrelevant to this systematic literature review process
05:26So, any type of literature review or any field can benefit from a systematic literature review
05:34Remember, the first part about its importance—I will just take five to ten minutes, and then we will quickly move toward the practice session
05:39So let's move to the second major reason why we conduct a systematic literature review: it follows a scientific, rigorous method
05:50There are steps you need to follow, and it is a very..
05:56A scientific way to conduct any study
05:58The way we do quantitative research, similar practices, tools, and platforms can be applied to systematic literature review
06:08Although some parts are different, the scientific method is the same
06:13Each research article or published paper would be considered your data point, so we can work with the data
06:20Therefore, we can include this quantitative methodology within the review process
06:23That's why it is very important
06:25I am not going to take you through the steps or the theoretical foundations of the systematic literature review process
06:34This workshop will be more focused on practical how you are going to conduct your research
06:38That's why I will go through these..
06:41Systematic, scientific methodological processes, and I'll try to teach you step by step with practice
06:48So be ready, prepare your laptops, and follow my steps once we are in the practice session
06:57Okay
07:06So, it follows the scientific methodology, and nowadays, with the available databases and also with the tools available for literature review, data analysis, and text mining, we can do systematic literature reviews very quickly, very quickly
07:16So that is an added benefit of doing the systematic literature review process or systematic literature review papers
07:24And, fortunately, this form of research article is easy to publish if you have conducted a good..
07:32In a literature review, you can find out which good journals can publish your systematic literature review process
07:38Nowadays, as an editor, I know most journals encourage writing at least one systematic literature review per issue
07:49This means that in any issue a journal publishes, at least one paper would be from a systematic literature review
07:54This gives us an opportunity to write more and makes it easier to get published
08:01So, this is another advantage of conducting a systematic literature review
08:04Why is it important? Because the most cited papers nowadays are systematic literature reviews
08:13If you follow the correct methodology and adhere to all the steps available for systematic literature reviews, your work can stand out and gain recognition
08:20A systematic literature review allows your work to be published easily, and at the same time, it can lead to highly cited publications
08:28This is because any work in a particular area would cite your research, as you have included all the relevant studies in your review
08:35Therefore, your work becomes more visible and is more likely to be highly cited
08:42This is very important for all researchers because we know that writing is our job, and citation is a major factor we focus on during our research
08:49Highly cited papers often involve systematic literature reviews
08:56That's why I encourage you to write more on systematic literature review
09:03Okay, these are the fundamentals of systematic literature review
09:11Remember, when you are writing a systematic literature review, we need to start with a certain point, and that point is asking a research question
09:24Always start your systematic literature review with a very clear research question
09:29Don't include many variables at once, such as moderators, mediators, or numerous concepts
09:36You cannot add many of these concepts in one literature review process
09:43If you want to include more variables, you need to conduct additional literature reviews
09:49Not one literature review is suitable for all topics
09:51So, focus on limited aspects
09:56Start with a very clear question
10:00Let me give you an example: my area is sustainable manufacturing
10:05I'm interested to see the current practices of sustainable manufacturing
10:07Manufacturing in the industry
10:09So that is a very clear question
10:12I'm trying to map what available practices are there to reduce carbon emissions to ensure societal protection and also at the lowest possible cost, meaning the economic side
10:25So my question is very clear: what are the current practices of sustainable manufacturing in the industry nowadays? So that is in the manufacturing industry—a very clear question
10:40So, what is your question? Please think about it
10:44You have to come up with one question because without that, we cannot proceed further
10:50Otherwise, it would be difficult for you to understand what is happening there
10:54So please be clear with your question and try to..
10:58Think and try to start
11:02I will give you 5 minutes after these slides
11:06You can just think about your research question and post it in the comments, so I can check and give you some feedback if it is relevant
11:12I can also pick some examples
11:14But everyone must start with a research question, and that research question should be very clear and not include too many variables
11:24Maybe focus on one variable, one concept, one construct, or at most, if you want to analyze one relationship, such as the impact of COVID on economic growth, the impact of a particular medicine on behavior, or the impact of salary on job satisfaction
11:45This means you need to focus on one relationship or one construct
11:48If the studies are more toward the..
11:53Scientific research should focus on one method, especially on the engineering side if you come from an engineering background or other fields
12:01So, focus on one experiment, one type of experiment, one field, or one construct, or one relationship
12:09Okay? These are the limitations of the systematic literature review process
12:14Okay, clear? I hope everyone understands this concept
12:17So, start your research question by asking yourself something—some research question which you are interested in finding out
12:26Do not include many variables; just one variable or maybe one relationship, for the basics of a systematic literature review
12:35Okay? So, let's start
12:37I'm just giving you five minutes to think and post your research question in the
12:45Comment box
12:49But remember, the research question should be very clear and to the point, not including many variables; just focus on one variable or one relation at a time
12:58Okay, so just wait for 2 minutes
13:02Uh, everybody can post your research question down there
15:53[snorts] [snorts] Okay, so I received a lot of research questions here
18:04I hope everyone is clear about the main concept of research questions now
18:11So, just two things: some of your research questions have included a lot of variables, maybe two or three, so just focus on one or maybe two variables, okay? And along the way, we will see what other interventions are available, but [snorts] start with the basics and very clearly
18:37Fundamental question, very simple question, so we can understand this process very clearly
18:39Okay
18:42Let's move now
18:44Now we are clear about our research question
18:47Everybody has something in their mind, particularly related to their ideas
18:51Now it is time to start writing
18:54It is time to start or convert your thinking into words
18:59I will give you some practical tips and some practices for this systematic literature review process
19:07You can follow my steps as well
19:09Okay
19:10So let's move to the next point
19:12The first component of this research workshop is already completed
19:18So we are very clear about the fundamentals—why we do a systematic literature review, why it is important, and what your basic research..
19:30Questions, and we need to understand again, I'm telling you again and again this: don't include too many variables, just focus on one construct, one experiment, one variable, or maybe a maximum of one relationship at a time
19:44If you want to include more, we can extend the type of systematic literature review later on because if you include more variables, we will move towards meta-analysis and finding out their results
19:57We will see how to do that in future workshops, but for now, we are very clear about the research question
20:07Good, I'm receiving good research questions, but try to see some of these research questions—they have multiple variables
20:12So, one variable or one relationship is okay, so we are clear about..
20:18Our research question
20:21So, my research question, which I'm going to take for this workshop, would be basically on the current issue of COVID-19—the impact of COVID-19 on the economy, maybe in broader terms, or maybe some people have already mentioned public health, and some people have already mentioned some other forms
20:40COVID-19 is affecting every part of your, every aspect of your life, so that's why you can do a lot of research on this
20:48So, my focus here is to find out the impact of COVID-19 on the economy
20:55Maybe I'll just take this example with you, and we'll see how this research is being conducted as a systematic literature review
21:06From here, up until the production of my full manuscript, I will guide you
21:10Different types of tips
21:13And let's move to the second point
21:15Now, the first point: I remember my research question
21:18This is, what is the impact of the COVID-19 pandemic on the global economy or whatsoever you want to see
21:24Okay
21:30Now, the most important part: what is the format of the paper? Remember, writing a systematic literature review is easy but at the same time it is tricky
21:36It does not follow the sample template for research articles we typically use, but it has particular, maybe a bit different—not a lot, but very few differences—between a normal paper and a systematic literature review paper
21:52So, let me start with the paper format, and then we will see how we can move through each part of this manuscript
21:59Typically, the manuscript, if you see, has basically an abstract
22:11The second point would be your introduction
22:12The third point would be methodology, including writing the methodology
22:17Then, the results and interpretation, followed by the discussion
22:21And finally, the most important part of any systematic literature review process is to provide a future agenda
22:26These are the six major components of your systematic literature review paper
22:33Remember, we have to write each and every component independently
22:37It is not mixed together
22:39I will tell you how, and you can write each component simultaneously
22:45So, we'll see how we do this practice
22:47Now, writing an abstract is very important, but this is the last step
22:52Step of your research
22:57So that's why I will try to tell you, uh, in the next, uh, session or in the next, uh, workshop, how we can write an abstract for a systematic literature review
23:02But today, my focus would be more on writing the introduction, writing the methodology, and if I get some time, I will tell you how to write results and interpretation
23:13But for results and interpretation, we need Excel
23:21For methodology, we need to use tools like kus.com, Web of Science, ProQuest, or other databases, and I will give you different steps
23:30But for the introduction, we need to start with our research question
23:35Okay
23:40So remember, the art of writing is basically based on one rule: eat an elephant bit by bit
23:45You cannot eat it all at once
23:47So just focus on..
23:50Small pieces of information you have in your paper
23:55Okay, so each component—like we have these six components—you have to subdivide each component into different parts and then try to write
24:06I will tell you how each component is divided to make it easier for you to write
24:11So, let's see how the introduction part is divided
24:16The first thing is that in the introduction, we have three subsections
24:26Writing from your question is very simple
24:29I'll just give you one example and also tell you about some parts of each subsection
24:34Then, I will provide some published paper examples so we can understand how to write it
24:41The first thing, and the most important, The important thing you need to understand is that the introduction section may be composed of a maximum of 1,000 or 1,500 words
24:47Usually, 800 to 1,000 words is a normal practice
24:56So, in a systematic literature review paper, you need to write an introduction of up to 1,000 words, or if your information is too much, you can go up to 1,500 words
25:07This is how I generally divide it in the introduction section
25:13But in the introduction, we have three major components
25:17The first one is what is the existing knowledge available on the problem
25:22You always need to start with this
25:25If you see well-written papers, they will tell you, "Okay, in the past 20 years" or "in the recent last few years," "researchers have focused on this area." In the past decade, research has been telling us that they always start with the problem and existing knowledge on the problem
25:45Okay, so what is already available if we face this problem? Do we have enough literature available in the research or in the field of our study? If yes, what is that knowledge? Okay, so we need to map this knowledge
26:05Then, the second reason why we do research is to extend the body of knowledge
26:16Extension means you find some limitations in the existing knowledge
26:25There are some gray areas in the existing knowledge; that's why you want to do this research
26:27Otherwise, there is no benefit in doing your research if it has already been done before, maybe a small part or some different elements
26:37You can see, but you need to find out what the limitations of the existing literature are
26:41Okay, this is the second component
26:44And then the third component is about your research question
26:50What is new? Why do you want to do this research? Why is your research question very important to you and also to humanity or the field of knowledge? Okay
26:58But remember, we need to write 500 words for each
27:04I'll give you one example, a very simple example for this
27:07Let's say, in my area, which I mentioned, the research question was very simple
27:14The research question is, what is the impact of COVID-19 on the world economy or the global economy? Okay
27:24So I have to divide my introduction part into these three sections
27:26So, what I did was, I prepared some key points for you
27:29Okay
27:32So
27:35What I did was take information from Worldometer or, uh, World Health Indicator
27:38So I just wrote that information into the form of the existing issue
27:43The issue is being escalated and then started from China, and then spread to all over the world
27:51Now countries are facing this issue
27:54This is how the current understanding of COVID-19 is, and most importantly, we don’t have any vaccination
28:04An important factor is that all the economic activities have been suspended, most of the flights are not going there, supply chains are stuck, and so all these economic issues are present
28:18Okay, so this is our current understanding of the situation now
28:23As for limitations, the second component is limitations
28:26So, in..
28:33The limitations, I explain
28:40Okay, if this situation happens, why not we have any other available options? Our understanding, or our level of dealing with these types of pandemics, is not very good
28:47We don't prepare ourselves for these situations
28:49So, these are the limitations of existing knowledge
28:51The most important limitation is that when you do research on any virus infection or anything, it will be only within the health sciences
29:02But what about other fields of life? Now you see, the world is interconnected
29:06If you are facing a problem, a health issue, that will affect everything
29:12Now, the situation is, everybody can understand that situation
29:16So it means that your issues, the humanity issues, are not unidimensional or one-sided
29:20Two disciplines
29:25It is multidisciplinary
29:30All these challenges and issues need to be solved with the help of a team or through research that needs to be done in interdisciplinary or maybe multidisciplinary research
29:40That is the focus of my limitation
29:42Mainly, the research work has been done, but it was only focused on finding out the vaccination
29:50But what about if this pandemic situation happens? What about the response to this pandemic? What about disaster management and response? All these options are not available, so that is the limitation in the literature
30:06You can clearly consider this
30:08And then my research question: okay, so what is the solution? Now, how can we develop a response? This is the research on COVID-19 is not new, and many other researchers have already explained its potential to become a pandemic from an epidemic
30:30So, all these situations have already been studied
30:33But did we learn anything? If not, we did not learn anything from the past
30:40So, how are we going to secure our future? That is the major question
30:44So, that is my research question in this
30:46That's how we classify our research question with the introduction part
30:51So, this is how I end
30:54If you see the last line of this situation, it is: "We map the literature to understand what lessons were learned from the past and discuss the possible future scenarios." Finally, this is how we write the basis of..
31:04Introduction part
31:14So I would suggest everybody read this and try to write your research question in the form of these three subcomponents, and then you can merge them into one introduction
31:24But when you are writing, please be careful; each section should be dealt with separately, and then you can address it separately
31:32It is very easy for you to write and find the relevant literature
31:34So this is for the introduction part
31:36You need to write at least 1,000 words or maybe 1,500 if you have enough material for your research
31:45But most importantly, your research question should lead to something new in the literature, and you need to identify some limitations of the existing work
31:56That is how we construct our introduction
31:58That is a similar method we use for thesis
32:00That is the same method we use for other quantitative or qualitative research articles
32:06The research question is fundamental, and from that research question, you try to craft your introduction part
32:10Okay
32:13So this is the introduction part, the theoretical part
32:18Let's move to some practical work
32:24Now, I would request everybody to prepare yourselves, and if you have access to the internet and scopus.com, which we are going to use now
32:29So, the introduction part, I think, is clear now
32:32If you have any questions on the introduction part, you can post them here
32:38I’m just giving you five more minutes for the second section
32:43Once you are done, then we will move to the methodology part
32:48Which is the main and important practical work in systematic literature review
32:52Up till now, I have only provided you with the theoretical part
32:55Now, later on, we will start some practical work, but writing the introduction is the most important part
33:02So, if you understand it clearly, give me your comments
33:05If you have any questions, you can ask me so we can focus on that, and I will try to address your questions
33:12 What you need to do is divide your research question into three components in the introduction section
33:24If it is easy for you to understand how we divide this, I have already given you an example
33:29So, try to think about it and ask me some questions if you want to
33:34 Okay, some people have requested my slides
33:44Yes, sure
33:53I will
34:03Share all these slides with all the registered participants
34:05I will also try to create an e-certificate, which we will send to you via the email you registered with
34:12Okay
34:15Once we finish today's workshop, we will share the relevant material so everyone can work on it, and we can also practice together
34:39Okay
35:03Many people ask about the limitations and the third part, which is about your research question
35:27Let me explain briefly again
35:30The existing body of knowledge is very clear, but why do we do research? We need to identify some limitations of the existing knowledge
35:42For example, for basic understanding, some practices have been done in the..
35:50Different country scenarios are not in your country, so cultural issues may be different
35:54So, that is one limitation on the country side, and we also need to see what work has been done and what needs to be done in the future
36:05For example, let me give you this situation regarding COVID-19, which I already explained
36:08Existing literature is available; if you search on the internet, you will find information about the coronavirus family of viruses
36:15It's not new, but what happened is that even though the research was ongoing, there were some signals from different research articles indicating that there is a possibility that COVID-19 could become a pandemic in the future
36:33But did we take those findings and try to develop a response if something happens? Like this
36:42So, this is the limitation
36:45In the research, your research question basically identifies the limitation
36:50Okay, so you need to form your research question very clearly
36:54That's why I ask if you are clear about your research question; you are clear about what work has not been done
37:02So, the limitation is basically what work has not been done in the literature
37:06Okay, and the third one: then first, we explain the existing body of literature
37:13Second, we explain what work has not been done and that it is required to do that work
37:21And the third question is basically why I want to do my research, because that limitation allows me to introduce my research question and include it in the new body of knowledge
37:26The particular field
37:31So, that's why this is very important
37:36Your research question is important in that area
37:42So, please link up these three different levels: the first level, where you are writing about the previous knowledge; the second level, where you are writing about the limitations of the previous knowledge; and then you bring in your research question, explaining why you want to do this research because the limitations are already present in the previous literature
38:02The past literature is not able to answer my question, so that's why I need to investigate
38:06Okay? So, this is how we need to understand it
38:12Somehow, maybe people may not agree on a particular treatment
38:16Maybe people do not agree on the positive..
38:21...or negative relationship between the variables
38:23So, that can be your research question, and that can be your limitation on the literature, because if you map the literature, you find diverse findings
38:32So, you are not able to determine exactly what the nature of the relationship between these two constructs or between these two variables is
38:42Okay, that's why we start with the existing body of literature and then formulate research questions
38:47Okay, let's move to the third point
38:52I think we are very clear on these two things
38:55If you have, again, any questions, we have that Facebook page—you can write your comments, and we can start a discussion to find out more information because of the limitations on the..
39:10Let's move forward because I have a lot of work today
39:12It's a somewhat extensive workshop, but I hope everyone is with me
39:17So, let's move to the methodology, which is a very important part
39:19Remember, in a systematic literature review, we follow only the PRISMA framework
39:30Just follow this one
39:33This is a standard, and most reputable publishers and journals accept papers published based on the PRISMA framework or PRISMA statement
39:45Okay? So, you need to follow this PRISMA framework
39:48The methodology is very simple, and the steps are very clear
39:52Yes, we need to practice how we can write and how we can report
39:58I will give you guidance on reporting, and I will also try to provide some practice on how to do each of these steps
40:03The Prisma framework or the Prisma statement is a very useful resource or method for doing or reporting your methodology in a systematic literature review
40:08Okay
40:14Now, the Prisma framework has four components basically
40:19The first level is identification, the second level is screening, the third level is eligibility, and the fourth level is the inclusion of your research papers
40:25It's very simple
40:32I will give you one example; you just follow this, and I will also provide the link for this Prisma statement
40:38You can just download that template
40:41Most publishers agree on this Prisma framework, which is called Preferred Reporting Items for Systematic Reviews and Meta-Analyses
40:53Okay, so this is how we need to write and report our methodology
40:58If you follow this pattern, most likely your paper will be accepted for publication because this provides scientific rigor
41:06It's a very scientific method
41:10Okay, so there are four stages
41:13I will go through these stages and then we can do some practice sessions to see how each stage is different from each other
41:19Okay, so let's move to the identification stage
41:21Now, remember, a systematic literature review is basically to review all existing literature, as compared to narrative and other formats of literature review
41:38We can ignore some papers, and we can include others, because we try to see the literature which Supports our argument
41:47But in a systematic literature review, this is not the case
41:52In a systematic literature review, you need to report each and every study you exported or you conducted, or you saw during the search or query
42:00So whatever number is there, you need to report this one
42:07If you see here, a lot of studies were extracted at an initial stage, but later on, only 21 studies remain
42:12This is a published article in *Frontiers in Psychology*
42:18This is an impact factor journal with good credibility
42:21So, if you see, I can also give you some examples from *Renewable and Sustainable Energy Reviews* and *Journal of Cleaner Production*
42:30All these journals publish high-quality systematic literature reviews, but remember one key point
42:37The thing is, this is a common framework, the PRISMA framework
42:45Here is one tip: The methodology in each of your research papers would be almost the same, so you can make effective use of available resources
42:53You can do that; you just need to follow the template I will give you and the reporting items
43:02Just follow that and try to change the words you already have
43:05So, this research framework is not difficult for you to report and write
43:09It is very simple
43:13Some parts of your literature review process will always be the same, as it follows the same standards
43:17That part is very easy to write once you have practiced
43:20So, once you do that practice, it becomes easier for you to write a systematic literature review paper because 35% or 40% of it will be similar
43:27The part of the paper is repeated itself
43:33So, you can just utilize that experience when you do more search on it
43:39So, let's go through this PRISMA framework one by one
43:42The first step is identification, the second is screening, eligibility, and inclusion
43:47Remember, at each step I will give you some questions, and you need to write based on your own research question
43:56So, you just need to provide your answers in the comments
43:58Okay? The first thing is identification
44:00In this first step, you need to identify some key components, specifically how you are going to search the literature
44:12This is very important
44:14As researchers, we are all aware of the importance of keywords in research
44:17So, if your keywords are selected carefully and wisely, it will lead to more effective search results
44:22You need to use the exact article and the precise data you require
44:28The more your keywords are refined, the better your research will be
44:33So, please think now about the keywords you are going to enter into the search engine, whether it’s Scopus, Google Scholar, or any other database
44:48Consider how you are going to search for relevant literature, which is very important
44:54The second point is about entering these keywords—whether you're using Google Scholar
45:03Google Scholar is a search engine, not a comprehensive database, but it is better to use established databases like Scopus, Web of Science, ProQuest, EBSCO, or similar, as they are very good
45:14However, for this current workshop, I am going to..
45:21I will train you only on Scopus because that is the most widely used database, and most of us have access to Scopus
45:29If you don't have access to Scopus, try to follow my steps, and later on, when you have access to Scopus, you can extract your records very easily
45:39Okay, so the first step is to choose keywords, the second is to set search criteria or select the databases, and the third step is to extract your records
45:48How are you going to extract records? This step is very easy
45:53Mostly, if we see, we have 2,000 studies, 3,000 studies, and at the end of the day, we only have 20, 30, or maybe fewer
46:03I was just looking at some papers published in very high-quality journals, where they are reviewing just five research papers and still conducting a literature review process
46:13It is acceptable for publication means that the number of articles finally included in your research doesn't matter; only the criteria of how you extracted those records, research questions, or research papers are important
46:30So, that is very important
46:33Okay
46:37So now, what you need to do is please identify three keywords from your research question
46:40We already know what our research question is
46:43So, think about how you are going to search your literature
46:46Provide me with three keywords
46:49Post your three keywords in the comments, indicating how you are going to enter them
46:52You cannot enter a complete phrase; it is better to use one or two-word phrases, not lengthy phrases
47:00Okay? So, just one or two words, mainly your
47:03Variables or any problematic issues
47:05So please, uh, if you can write three keywords here, I would see whether it is possible
47:11Yes, PubMed is very effective, uh, for literature search
47:17I sorry I forget to mention this one also
47:21This is very important
47:24Uh, it's a really good, uh, database
47:28So all these databases, the relevant and uh, authentic databases are okay to use
47:32So please mention your keywords here
47:35Okay
47:39Good
47:42Okay, good
47:56Okay
48:11So in this, there are so many factors for oil prices, for health, for this, uh, only remember we can focus on one or two aspects only, not all
48:25This is called inclusion and exclusion criteria
48:27So you can focus on oil prices, you can focus on supply chain, or you can focus on one aspect of the economy
48:32Yes
48:34This impact of COVID on the economy is a very, uh, I think broader term, but you can narrow it down based on your own criteria
48:37So, that is okay
48:40Okay
48:42So, 3D printing
48:44Okay
48:46JSTOR is okay
48:48JSTOR is also an authentic, uh, database
48:51Now, elsewhere, basically, Scopus is powered by Elsevier
48:58So, if you want to use Elsevier, better you use Scopus
49:01Uh, and I'll give you why I want to use these, uh, established databases
49:04There is a lot of work; we need to understand why we use these, uh, established databases
49:07Okay
49:11Okay, let's move forward
49:14Now, we have already defined our keywords and we already have our search database
49:20Today, I'm going to use KUIS and then how we extract the records
49:26So, please remember, I'll just go through these four steps
49:28and then we do practice
49:31Okay
49:34So, the second step would be screening based on inclusion and exclusion criteria
49:37Very important
49:41You need to discuss, okay, whether you want to take all records or maybe just articles from the past five years, or perhaps from specific countries
49:44Maybe you are looking at only research articles, not review papers, conference papers, or published reports
49:56So, you need to define screening criteria based on your own understanding
49:59Okay
50:03Developed by you, but you need to apply the criteria
50:07Basically, you can include all the quantitative papers if you want to focus on those
50:10If you want to include qualitative papers as well, that's also acceptable
50:14If you want to focus only on review papers, that is understandable
50:18The studies on experimental design and so on
50:21Specific topics during experimentation or maybe some different types of medications
50:25So, you just focus on key points: what is included and what is excluded
50:35This is called inclusion and exclusion criteria, a very important factor in the PRISMA framework, and that we need to report in our methodology as well
50:44So, please identify whether you want to do your research based on some particular concepts or open options, such as particular countries or specific research paper types
50:53You can also consider whether to include only English or other languages
51:04That is the inclusion and exclusion criteria
51:06Let's move on to the next step: eligibility
51:09Once you have extracted the records, you need to evaluate each and every one
51:15Record one by one
51:18Okay, I will show you how to do that
51:21Each record you need to assess and decide whether to include or exclude
51:26When we are using multiple databases, there is a high chance of having duplicate entries
51:30Okay, so for duplicate entries, if we are using an Excel sheet, we can remove them very quickly
51:36But if you are not using an Excel sheet, it is difficult to remove duplicate entries in 2,000, 3,000, or even 200 or 300 papers
51:45That's why I encourage you to use Excel, as it is a very good software and very helpful in many ways for this research
51:55I will teach you some basic techniques for Excel as well, including how you can develop quick graphs and tables using PivotTables
52:02I will include those parts in the session
52:05In our workshop as well
52:09Okay
52:12So, quality assessment is very clear; you need to identify whether the area and the scope of this paper belong to your area
52:16You want to address the specific issue, so exclude all irrelevant studies
52:22Duplicate records should be removed, and any other quality assessment criteria, if you wish to add any features, must be established before you start
52:28Okay
52:35And then, the final number of studies included in your research
52:42Let me go back to this PRISMA framework slide
52:46If you see at the top, 3,453 studies were initially extracted, and later on, records after duplicate removal were 2,528, then records were screened, and the maximum records were excluded, and then they..
53:09Provided the exclusion method, why they exclude different particular records—some were not in English, some were not in scope, some were review papers—so all these were excluded
53:20Finally, they accepted only 90 at the eligibility stage
53:24Then they did another round of quality assessment and finally excluded 24 more, leaving only 21 papers included in this particular example
53:33Okay, so this is how we need to report and do our work
53:38Okay, let's move to the next step
53:41Okay, now let's do some practical work
53:50How do we do the identification? So for us, I divided my keywords into very simple: COVID, coronavirus, COVID-19, and remember, the keywords can be a single word or a combination of words
54:10Most importantly, you need to use Boolean operators
54:12Sometimes we are interested in articles that are published based on COVID and the economy, such as coronavirus or COVID
54:22So, using AND and OR can be utilized to assess the different types of research
54:28I will show you how they differ in research
54:30Okay, so let's see what database we are currently going to use—PubMed and the keywords I mentioned are COVID-19, coronavirus, COVID, and if we are using multiple keywords, then "novel coronavirus" and "coronavirus economy." These are the simple keywords I am using
54:52Okay, let's move to the practice session now
54:54If everything is clear and everyone is ready with your keywords and research questions, please let me know
55:04Just give me some comments
55:08So, let's move to the practice session
55:10Uh, and please, everybody should be on this website, www.scopus.com
55:15Okay, so, let's be prepared
55:21I'm just giving you 5 minutes to relax and prepare, and uh, start on this website now
55:28Okay, guys, everybody is here on this
55:41Okay
55:55Okay, let's just wait for 2 minutes so all of us should be ready
56:53Okay, let's start
57:51So, please enter your keywords in your Scopus database
58:50The first thing, if I'm using a single word, I can use it like this, uh, without any inverted commas
59:02Remember, inverted commas are used to specify a phrase or a multiple-word term
59:07For example, if you have two words like "employee performance," you should put it in double quotes
59:11Okay
59:16COVID-19, sustainable..
59:20Development, all these are multiple words but a single construct
59:24So, if you are using something like this, you need to add inverted commas before and after your word
59:31Okay
59:37So, this database understands that once you have these inverted commas, anything within these inverted commas will be considered only one word
59:44Okay, one keyword, not multiple keywords
59:48So, that's why it is very important to understand this while entering your keywords, it is crucial to use them correctly
59:54Okay
01:00:01And each database has its own different types of operations, like Web of Science, which has different operators; PubMed, which has different features; and ProQuest, which all have their own specific functions
01:00:07You can find out the tips to search for any of these databases here, but more or less, the operations are the same
01:00:21We are using multiple words as a single construct, so that's why we need to include inverted commas before and after your words
01:00:25Okay
01:00:30So, let's say "COVID-19" with the hyphen
01:00:35If I search, how many studies I will find? Okay
01:00:41If you see, I have 1,516 studies on COVID-19
01:00:49Okay
01:00:52So, all of you can practice your first keyword and write how many research articles or records you find on the Scopus database
01:01:07Anyone who is doing this, can you? Okay, for Scopus, your institution mostly has access to the Scopus database
01:01:12Okay
01:01:17Most of these databases, unfortunately, are paid
01:01:22So, that's why we need to find out
01:01:25Any method to access these websites? But there is a very simple criterion
01:01:31If you are reviewing any article from elsewhere, they will give you one-month free access
01:01:40So, if you keep reviewing their articles, they will give you free access to their databases
01:01:44That is a very important method
01:01:46Similarly, I am accessing Scopus because I am reviewing this elsewhere journal, so they give me free access to it
01:01:56I would suggest everybody record their interest in reviewing articles; if you review, they will give you one month free
01:02:05But unfortunately, I don't have any other alternatives, so you need to try to find out the method through which you can get access to this Scopus database search or access
01:02:16Okay
01:02:27Okay, now we— Let's say, okay, here, if you see, you can define whether you want to see this keyword only in titles, abstracts, or keywords, or maybe you can use other options
01:02:38Okay, you can choose only abstracts, only keywords, or titles—it's depending on your need
01:02:44But usually, what I do is I use article titles, abstracts, and keywords
01:02:48This is the most important information
01:02:51And the Scopus database, remember, Scopus doesn't have all full articles; it is a database of indexing that only indexes your abstracts, references, and other metadata
01:03:04But we need to utilize that or maybe capitalize on the information we have
01:03:11So, let's search
01:03:13We have this 1,516 articles
01:03:17Okay, if you see, this interface is very interesting
01:03:29Those who cannot access Scopus now..
01:03:31They can request it from your friends, just give them the keyword
01:03:38Those who have access can extract the records for you and send them to you
01:03:43So you can still work, but within the research network, we can help each other, and that is why I try to create that group
01:03:50We'll try to help each other and provide resources to all researchers
01:03:54So whatever we can do, but obviously, for that reason, we need to work in teams and groups
01:04:00Okay
01:04:02So everybody already has it
01:04:07Okay
01:04:12If you have 121,942 results, that's a lot of results
01:04:17If you receive so many studies with your keyword, it means that the area you're researching has been extensively studied, or you're using not very precise keywords or very simple keywords
01:04:34For example, if you are using, let me show you this example
01:04:43If you are using—or maybe, let's move to more sustainable manufacturing
01:04:52Okay
01:05:02So, if I search without entering any inverted commas, you will see I receive 14,625 articles
01:05:11But if I use this correctly and put inverted commas before and after this keyword, the studies would be slightly fewer—or maybe much fewer—than this
01:05:32You can see that from 14,000, now it is only 2,281 studies
01:05:39So, either you are not using your keywords correctly, or your area is too broad, and there is a lot of research already available on those particular keywords
01:05:51So, you need to specify or narrow down your research
01:05:56The way somebody asked me, uh, if, if..
01:05:59You can consider all economic aspects of the code
01:06:02No, if there are many studies, we can just focus on one or two areas
01:06:09But what I understand for now is that COVID-19 has not been studied extensively in social, economic, and business contexts
01:06:17That’s why you will see a limited number of studies
01:06:19Okay, let’s move on
01:06:21Is it clear? Okay
01:06:24If it is clear, any questions or queries on this? Yeah
01:06:361969 results are acceptable
01:06:3977 results are also acceptable
01:06:42Okay
01:06:45No problem
01:06:48That’s a good number, so it indicates that your area is relatively new
01:06:51But we are not searching with only one keyword; we have different keywords
01:06:55Remember, we have three or four keywords, so we may receive more articles later on
01:07:023,965 is okay, and it’s also a good number
01:07:06We can work with it
01:07:09Okay, 10
01:07:13Okay, 10 is okay, but we will try to search for more different keywords
01:07:18Okay, done
01:07:23Let's move to the next point
01:07:28Now we are already on the keyword "sustainable manufacturing," and I just searched here
01:07:35I'm just trying to teach you how to extract the data, and later you can practice, and we can do another session
01:07:45You can give me your comments and share any difficulties
01:07:48If you miss or skip any point, we will upload this video to our Facebook page as well
01:07:57It is available on our YouTube channel, so you can watch it later
01:07:59This video will be accessible for you
01:08:02Okay, so for "sustainable manufacturing," we have 2,281 records
01:08:07Now, these records include everything—open access, closed access, reports, review papers, everything
01:08:21Now we need to identify our second criterion
01:08:23Okay
01:08:26If I go back to this slide, you remember—just a minute
01:08:28My laptop maybe
01:08:35Okay
01:08:41So, we have this criteria: inclusion and exclusion criteria
01:08:48Now, this is very important
01:08:51Okay
01:08:53Now, you need to decide whether you want to cover 25 years, 20 years, 10 years, 5 years
01:08:56It is up to you
01:08:59You need to define whether you want to focus on particular countries, whether you want to include review papers, conference papers, all types of records, patents, and everything, or whether you want to limit your research to some specific context
01:09:16So, let's see how we can narrow down those areas
01:09:19But first, I want to show you one thing
01:09:22Most of us may be aware of this, but many..
01:09:25You may not be aware of this feature
01:09:27If you go here to analyze search results, Scopus will automatically analyze your data and provide you with some fruitful records, or maybe usable graphs, figures, and tables
01:09:44Just click on this, and you will see that Scopus has created all the records you need to report in your research
01:09:54Okay, this is year-wise data
01:09:56This one basically shows the distribution of research articles by year
01:10:05And then, if you go here to view by source, different types of journals, by authors, by university, distribution by country—you can see different countries there—and then document type, subject area, and even funding information is available
01:10:27So, there is a lot of information already available on your research
01:10:30Scooping
01:10:32So, you just need to extract these figures and report them in your research
01:10:35Sometimes we don't need to do a lot of analysis ourselves, but there are a few steps we need to follow to make it more reliable, or to assess quality, and then we need to do it in an Excel sheet
01:10:52That's why, if your search allows you to find these graphs and figures, that's fine—no problem
01:11:01Okay, so let's see how we can reduce this number and filter some information
01:11:07Here, if you see the left side of your screen, you will see different options, the access options
01:11:16Currently, there are a total of 571 open access articles and 1,710 others or closed access articles
01:11:25So, if you want to filter to only open access or closed access articles, you can do that
01:11:28It
01:11:30Then, the number of years—you can see all the information is available
01:11:33If you want to just select five years, let's make it from 2015 to 2020
01:11:38Now, let's see how it works
01:11:45Or maybe, in some research, we exclude 2020 because it is not completed yet, so we just include data from 2015 to 2019
01:11:51Then, if you want to use, remove, or add a particular author, you can do so
01:12:00Subject area selection is very important
01:12:05Okay
01:12:10Sometimes we are dealing with engineering research; if you are working with engineering, just use that engineering data
01:12:15If you are working with management, business, or other areas, you can categorize your field
01:12:17So, in my case, if I am just using business management and perhaps environmental..
01:12:24Energy decision, not particularly in engineering and the social sciences
01:12:29So this is how I narrow my search to a specific area
01:12:31Okay
01:12:35And then, the next consideration is whether the article is in press or fully published
01:12:40So, this relates to the publication stage, which is also an important point, and the document type—as I mentioned, whether you want to select full articles, conference papers, review articles, book chapters, conference reviews, or other options available
01:12:54I just want to include only review articles
01:12:59Okay
01:13:04Sorry, only full articles, and maybe I can exclude review articles and conference papers, depending on your inclusion and exclusion criteria
01:13:09The most authentic source of data is available with the article
01:13:12Then we have conference..
01:13:15Paper and review, so book chapters also can be included, and conference reviews depending on your choice
01:13:22But whatever you choose, you need to mention it
01:13:25I will show you how you can mention that
01:13:27Okay, the source title means the journal
01:13:30If you want to work on a specific journal, you want to see what is the contribution of that specific publisher or journal in a particular field, you can select that
01:13:41For example, if I want to see what is the contribution of *Cleaner Production* in sustainable manufacturing, I can just focus on *Cleaner Production*, and then we can report our results
01:13:53Similarly, you can focus on some other keywords
01:13:56Now, all these are keywords used in these studies, so you can just focus on— Maybe just sustainable manufacturing or manufacturing sustainable development, you want to take it or not
01:14:09So you can just categorize or subcategorize your keyword affiliations, sponsors, fundings, and all these
01:14:14And then, important countries
01:14:19Okay, so the countries are very important
01:14:24If you are looking for only a few countries, you can do it
01:14:28If you want to see more countries or all countries, you can just include them
01:14:30Now, I'm interested in all countries
01:14:32So let's see
01:14:34And now I limit my search to these options which I choose
01:14:38So I just click here, "limit to," and then I will see how many records are available for me based on my choice
01:14:45Okay
01:14:51Now, you can see there are only 407 documents available based on the criteria I defined
01:14:57Assessment and inclusion and exclusion criteria
01:15:03Remember, quality assessment has not been done yet
01:15:05It is just the criteria I defined for inclusion and exclusion
01:15:11Okay, so clear? If clear, just write a comment
01:15:13If it is clear, then we can move on
01:15:21Okay
01:15:23Some of the people mostly mention that they don't have access to Scopus
01:16:10I will explain it to you again: Scopus or any other database you want to use requires a fee
01:16:19Your institution, a higher education institution, may have access to these, but in countries like Pakistan, we do not have access to Scopus through HEC
01:16:31However, we have many friends who are studying abroad or in different countries, and they have access
01:16:38Access to Scopus so you can request them to send the sheets
01:16:39I will tell you what the sheets are after using those queries with you, so you can utilize that
01:16:47But please don't give up; we have alternative options
01:16:50And remember, Scopus is not the only database
01:16:55You can use other databases as well
01:16:57But it is easier to use any established database for systematic literature review rather than going for Google Scholar
01:17:05Google Scholar may be difficult for systematic literature reviews, and it will consume more time
01:17:11Okay, now we have these records
01:17:12The next step is to extract those records
01:17:19Very important—we need to understand
01:17:22You can select all here, click here, select all, and then click export
01:17:28I will show you this option
01:17:33Everybody can see these options
01:17:3748 results are okay
01:17:45No problem
01:17:52Okay
01:18:00We can focus on 48 results; 48 is okay for one keyword, but later on, you have other keywords, so you can just use other keywords as well
01:18:08Okay, let's export this result
01:18:23Let's export this result
01:18:28If you see, all this information is available
01:18:30Click on all options
01:18:31We are going to extract all information
01:18:33We have to include everything available in the Scopus database
01:18:38So, that's why I click on everything, and then you need to select the option here, CSV file, CSV
01:18:42Okay
01:18:46So, here you can see the CSV file
01:18:50Click here, and then you just click on the button on the right side called export
01:18:59Okay
01:19:08So, just click on this export button
01:19:17Okay
01:19:26Here is this file, file Scopus CSV
01:19:35We can open it in an Excel sheet now
01:19:37This is the record we have extracted; this is the sheet
01:19:45I ask you, you can request your friend to send you it—it's easy, it can be done, and your friend can transfer it to you
01:19:57No issues with that
01:20:10Okay, so even though you don't have access to this Scopus file, you can ask any of your friends to follow your keywords and send you this sheet because, no matter where you are doing your search from, no matter which country, which institution, or which internet connection you're using to log into Scopus, when you enter these keywords, the results will always be the same until new studies have been added
01:20:22But remember, this is the result, and that's why we..
01:20:24Call it scientific rigor
01:20:27So no matter if you exclude or use these keywords, or if your friend uses this keyword, they can send you this
01:20:33Very simple
01:20:40Okay
01:20:46Now, let's see if the information is there—all types of information are available—and we have this Excel sheet with us
01:20:52Okay
01:20:57So, let's see what information—authors, title, years, countries, and all this information—are available
01:21:03Now, we can work with this
01:21:04We have a lot of options in the Excel sheet
01:21:07I will try to show you some of these tools and techniques while we are working with the results part
01:21:12But for now, we are just interested in the extraction of the data
01:21:18I'm not working with this record
01:21:21Yes, we can see one by one, and we can use this command to check whether we..
01:21:27Have duplicate records or not
01:21:29If you want to see duplicate records, you can just click on the title
01:21:34You can see this in Excel; you have conditional formatting
01:21:36You can just highlight the duplicate records
01:21:41If you don't want to delete them at the first stage, there is another option in the Data menu
01:21:51You can just filter these duplicate records
01:21:55Okay
01:21:59So, if you want to just highlight the duplicate records, you can go with this option and click on Duplicate Records, and then it will show you the duplicates
01:22:04We don't have any duplicates here because it is only one database
01:22:09Let me just create a duplicate so we can see how to filter them out
01:22:19Okay, I copied this and pasted it here
01:22:26So, technically, now we have duplicates
01:22:30Records in our software
01:22:36Okay
01:22:41Now you see it has already highlighted your duplicated record, so it is very easy for you to track these duplicate records
01:22:43Okay
01:22:46Okay
01:22:49Let's move to the next point
01:23:00Now we are very much okay with this
01:23:05If you want to delete this directly, you just go to the data tab and here you have the remove duplicates option
01:23:14You can just directly click on Remove Duplicates, and the duplicates will be removed
01:23:18Okay
01:23:23So in column C, we have—if you see, now the duplicate is removed
01:23:28So, we have many easy options in Excel to work with
01:23:31Okay
01:23:33Now we have our Excel sheet extracted
01:23:36So, we are clear with the basic or fundamental rules of working with this database, and we can export all these
01:23:43The beauty is that the title and the abstracts are already here, so you don't need to go through each paper
01:23:52You can just read the abstract and decide whether this paper is related to your area or not, and then you can include or exclude that particular paper from your database or record
01:24:10So, you can just follow this abstract, as the most important information is here
01:24:15Later, we will study how we can use these abstracts to create meaningful graphs, tables, and so on
01:24:23For now, I am just focusing on this extraction of the record
01:24:28So, is everybody clear on the record extraction? If you can follow me, that's okay
01:24:33If not, the video will be saved, and you can follow these steps later on
01:24:37Learn how we can move on
01:24:39So, for the export option, you need to click on 'Select All Articles,' and then the export option will appear
01:24:53If you missed it, you can just watch my video again and follow these steps
01:24:56I have already explained each step one by one, so it should be easier for you to understand
01:25:03Now, let's consider that you have already exported your data
01:25:06Each record represents one paper, which is your data; one record equals one paper
01:25:15Okay? So, now what we are trying to do is conduct a systematic review
01:25:20It is a simple literature review, but now it is based on a scientific method
01:25:26Do you understand? Now we have the records, the data—once you have data and numbers, you can present it in many ways
01:25:30Ways
01:25:33We will see some of the basic techniques on how we can show these
01:25:37Okay, let's quickly move on because the time is very short now
01:25:45I hope so
01:25:52We have to delay or maybe stop our presentation after this methodology part, and we will have another session of this workshop next week, so we can continue
01:26:00I hope everyone is interacting and learning, but I feel we cannot complete this in one go; it's not easy for everybody to digest all this information
01:26:14So, let's break it into two sessions
01:26:16In the next session, we'll try to deliver the remaining parts next week
01:26:18Okay, so let's focus again
01:26:21Regarding quality assessment, once you download your sheet, you need to remove duplicates and outliers
01:26:28For the scope of publication, you need to remove all other irrelevant publications from your records
01:26:37Okay
01:26:47If you have data from multiple sources or multiple keywords—let's say I use the word "sustainable manufacturing." If I use another word, "sustainable development," then there would be some more papers, but most of them may already appear in my first search
01:26:57So, I need to combine and create only one sheet for all of them
01:26:59Okay? So, all of them should be recorded and all should be converted into one Excel sheet, and then we remove duplicates
01:27:06Next, we apply quality assessment criteria and check eligibility
01:27:14Then we finalize our records
01:27:16Okay? Let's move on
01:27:18The final step is basically… Inclusion
01:27:20How many papers have you already included? So, this is how we do literature search and database extraction
01:27:30This is the main component of today's workshop
01:27:35So, this is all about this information
01:27:37I have already explained all of this, so just quickly browse through these slides because I have practically explained it to you on the database
01:27:49It's easier for you to understand
01:27:51But if you don't, I will try to share all this information with all the registered participants
01:27:55If you have not registered, please use the link; I will add this link to the description so you can register and become a member of our community
01:28:02We will try to send you more information on it
01:28:05Okay, let's move
01:28:08So, this..
01:28:11Here are some of the practical criteria for reducing your results, the findings
01:28:17This is how we export the results, now it removes duplicates, out-of-scope entries, and recordings
01:28:23Now, the most important part
01:28:27This is what we have already done
01:28:30I think everyone is clear with these steps
01:28:32If you are not clear or have any questions, you can just comment, and if you are clear, please comment as well
01:28:40Because I can understand from your comments whether things are going well or not
01:28:43So, please comment if it is clear, then I can tell you how to report the methodology part in your research article
01:28:50I have already explained how to write the introduction section; now I will tell you how to write the methodology part
01:28:59The next step would be writing the results, the conclusion, and also the future agenda that we will try to cover in the next presentation, possibly next week
01:29:08So, we'll announce the date later on
01:29:16Is that clear? Okay
01:29:24Now, the most important part is how we report this in your research
01:29:32I explained to you that in systematic literature reviews, we have about 30 or 40% of repetitive formats if we are using the PRISMA statement
01:29:43Every time you conduct research, you need to follow these steps and report them in a particular way
01:29:51So, that's why if you are doing a systematic literature review, you can produce a series of research articles based on one or two of your reporting criteria
01:29:56So, reporting is very straightforward
01:30:01Whenever you need to report your..
01:30:06Methodology, you need to follow these particular steps
01:30:10Okay, these steps are basically four steps you need to report
01:30:13The first is your search strategy
01:30:18The second is your selection criteria, and the third is your quality assessment
01:30:26The final step is your data extraction, which involves how you extract the records from the databases
01:30:32Let me briefly explain each one to you
01:30:34 First, we see how to report the search strategy
01:30:37This is how I report the search strategy: for this systematic research, we develop a search strategy to identify relevant literature
01:30:48This was tailored for four databases: Scopus, PsycINFO, Abāqos, Web of Science, or any other databases you want to report or extract records from
01:31:00The terms used were following the coronavirus or COVID or COVID-19—that is, your keywords
01:31:08So, you need to report those keywords specifically here
01:31:12All searches spanned from the database inception until 2020
01:31:17In that case, all records were included, such as journal articles, review papers, and research reports published in English only
01:31:27This is how you report what you have done in your search strategy
01:31:31So, whatever you have done in your search strategy, you need to report it here
01:31:36Okay, clear? Okay
01:31:40Now, the second step is the selection criteria
01:31:44We are very clear about our selection criteria as well
01:31:50We are using the PRISMA statement, which was developed by Moher et al
01:31:52in 2019
01:31:55You can also see their website
01:31:57If you write PRISMA statement, you can find their website
01:32:00The search is mainly focused on mapping existing knowledge on COVID-19 in the field of social sciences
01:32:07Now, this is important: fields of social sciences, environmental sciences, business, and economics
01:32:11We did not include engineering, biomedical, or other such fields
01:32:21So, we just focused on some particular aspects, not all aspects
01:32:24Okay? So, you can narrow your search based on your relevant field of interest
01:32:31The search was then narrowed to the subject areas of environmental science, multidisciplinary social sciences, psychology, arts and humanities, and earth sciences
01:32:39So, you understand what we did
01:32:41We have just reported here as
01:32:44Exactly the way we did in our search engine
01:32:46Okay, so this is how you report your methodology
01:32:50The time span and, if you are focusing on some particular countries, you need to find out or explain, for example, ASEAN countries or a specific region
01:33:02Finally, a total of 85 articles were excluded at this stage
01:33:08There were 105 records extracted at this stage
01:33:12So, you need to report exactly what number was there, how many you excluded, and how many you included based on the criteria
01:33:23Every time you perform a systematic literature review, you need to follow this particular pattern
01:33:28There is no need to deviate from this pattern until you are experienced and an expert in research; then you can
01:33:34Create your own way
01:33:36But for the basics and initial start, just follow these patterns
01:33:38Okay
01:33:40So similarly, for quality assessment, we have already included in our discussion that we are going to use only English
01:33:47Duplicate results we have removed
01:33:53We also remove non-English and other studies that are not in the scope of this research
01:34:00So, this is how you need to explain the quality assessment and reporting of quality assessment in your research article
01:34:07Okay
01:34:09So, the third section of methodology is quality assessment
01:34:12I think it is very clear according to the PRISMA statement
01:34:16That framework you need to follow, and then you need to report these four sections
01:34:18Okay
01:34:21And then, finally, data extraction
01:34:23You We need to specify what exactly was extracted and how many articles were included in the final search
01:34:31Okay, here I mentioned that 45 articles were extracted, but based on peer-reviewed papers, conference papers, published reports, and case studies were excluded
01:34:45The articles must be in English, and the time span was from 1980 to 2020
01:34:50The countries considered were only ASEAN countries
01:34:52Please provide a report of the previous three steps
01:34:56Okay, so this is how you should report the data extraction part
01:35:03This is the main methodological part
01:35:08Let me show you again
01:35:11Everyone should be clear on these four steps
01:35:14Okay, the methodology we have to report in these four steps: search strategy, selection criteria, quality assessment, and data extraction
01:35:31Assessment and data extraction
01:35:33In the search strategy, you need to specify what keywords you have used, which databases you have used, and what the time frame is, such as the number of years or the specific years included in your search
01:35:39Okay
01:35:44The second part is the selection criteria; it's very simple
01:35:50You need to define your selection criteria, including how many articles from which years, possibly focusing on particular subject areas, or explaining that some papers were excluded because they were out of scope or for other reasons
01:36:06Here, you also need to mention removing duplicates—by exporting from the Excel sheet and excluding duplicates, non-English language articles, and out-of-scope papers
01:36:19Then, the final selection is made
01:36:21Figure, uh, you give this okay
01:36:26This is the final number
01:36:31Uh, we, uh, after the quality assessment and the final data extraction, you just briefly explain in three or four steps what your qualitative data extraction involved and how many total articles were extracted
01:36:36This is how we report the methodology in the systematic literature review process
01:36:41I hope it is clear to everybody
01:36:47Okay
01:36:52Study scope: basically, we need to mention whether our studies are focused on a particular area
01:36:57I'm interested, for example, if I'm looking at COVID-19 and its economic impact, I’m not interested in clinical trials, such as what is happening to the virus and how doctors or researchers are trying to find a cure for it
01:37:19Virus or vaccination that is out of my scope
01:37:21So any study which focuses on clinical trials is out of my scope
01:37:27My area is basically looking at how this COVID-19 pandemic impacts the economy, maybe supply chains, your business, inflation, anything related to the economic side
01:37:39Okay, so that's why I will just include the studies related to business, economics, and multidisciplinary topics
01:37:48But when you extract this sheet, there is a chance that some of the studies may still not be within your scope
01:37:58Although you extracted from business journals, there may be some studies that are interdisciplinary and still provide trial, clinical trial, or vaccination information in your search
01:38:13You can exclude those particular fields from our research
01:38:16They are not required
01:38:19Okay? So even though you use those criteria on your Scopus database, when you extract the data into Excel, you need to filter it again
01:38:30You need to develop quality assessment criteria and then apply it again
01:38:35Okay? Don't believe that you have included or excluded everything from there and that no studies are left; all studies are in scope
01:38:44No, you should quickly go through the abstracts of each article and see whether they are related to your scope or not
01:38:51It is only 40, 50, or 60 papers
01:38:54You can do it quickly in 2 or three hours and identify which studies are not relevant to your research and which studies are relevant to your scope
01:39:04So, that's why this is how we need to do the scoping of the research
01:39:08Okay, clear
01:39:10So, I think we should stop here
01:39:12Allow me the opportunity to open the session for questions and answers
01:39:19The next session will cover reporting, writing the conclusions, and future recommendations
01:39:27Today, we just learned about the basics of systematic literature review, the methodology, how we extract the data, and how we work with the Excel sheet
01:39:36But next time, everybody should be more prepared because we are going to do some practice sessions with Microsoft Excel and other software that we can use for data extraction and analyzing your data easily
01:39:51We will also develop nice and beautiful graphs and figures to include in your research
01:39:55Okay
01:39:59So, it's not only about what you do in research, but also how you present your research that is more important
01:40:03I will give you tools and techniques on how you can develop beautiful pictures, figures, and graphs from your data, which we exported just now from Scoops
01:40:13Okay? So, that we can include in our study, and then I'll show you some of my examples as well, to make it easier or perhaps serve as motivation for you to use different tools for your research, not just one
01:40:26Okay? So, let me open the session for questions and answers
01:40:28If you have any queries or questions, we can take them for the next five or ten minutes
01:40:37If you have any questions, please write in your comments, and also let us know if you like it or if you have any misunderstandings or if something is unclear
01:40:45If there is anything unclear or if any questions are pending, you can write them, and I can address your questions
01:40:55Okay
01:41:05So, what about the review paper publication? Now, I assume that after this session, you will at least be able to work up to the methodology part
01:41:15Before the next workshop, you should be prepared with your paper; at least the methodology part should be clear, and you should be working on your introduction and methodology sections
01:41:31In the next workshop, we will try to complete all these pending parts, and then I will give you one more week to complete your papers
01:41:38Okay
01:41:45So, within two weeks, those who want to publish need to complete their research work, and I will share the email IDs; you can send it to us
01:41:52Review, and then we will try to formulate some special issues for you, free of charge, obviously
01:41:57This way, we can publish within different journals, and if any editor of a journal is present, kindly let us know if you have any venues for publishing these papers, so we can work together
01:42:12We will allow everyone to publish their work, and we will try to create this opportunity through this network
01:42:20So please, I think it is better to sign up with our Facebook page and also register, so at least we have your email ID and can communicate with you and send you more information
01:42:32Regarding certificates, they will be given to you after the next workshop once the literature review process is completed
01:42:46The systematic literature review is completed
01:42:49So, everybody, I will try to create a webpage where we can discuss, and I will send you the e-certificate after the next workshop
01:43:00However, a certificate of completion will be issued once you have completed your research article and sent it for review to the journal
01:43:11We are working on the journal list, but some of the journals I have already explained at the start
01:43:41We will send you the list of journals so you can check them, and if you are interested, then we can work on it
01:43:50Okay
01:43:59How much time will it take to write a systematic literature review paper? If you are trained enough, you can write a systematic literature review paper within one week, but it requires practice
01:44:07If you are new, obviously you will take more time
01:44:12But we are giving you two weeks, so this is your homework
01:44:14Now, before the next session, it is good if you can complete up to the methodology and start writing
01:44:21I have already explained all the parts of your literature review paper up to the methodology
01:44:28I will share the slides and also some relevant content, maybe tomorrow
01:44:33So, you can just use those and try to produce your paper, but up to the methodology
01:44:40If that is clear, in the next week, we'll complete the rest of the work, and then you can finalize your paper
01:44:47So, it typically takes around two to three weeks for a new person to create a systematic literature review paper, but if you..
01:44:55You are trained enough, you are good at Excel, you are good at different software, you are good at writing, so maybe you can complete it within one week; there is no issue
01:45:00But it needs practice
01:45:05The more you practice, the easier it becomes for you to write
01:45:09Okay
01:45:14From Esco, ProQuest, and all other databases, yes, you can extract the data
01:45:18You can extract an Excel sheet from all these databases
01:45:24It is easy to extract, and if you don't have access, there is another alternative: you can export it to MindLine or any other software, and then also export it into a CSV file or Excel sheet
01:45:36But ProQuest, Esco, and all other databases, PubMed, and all these, they allow you the opportunity to export your results into an Excel sheet
01:45:43You can directly export, no
01:45:50Um, okay, for writing empirical papers, yes, we can do this
01:45:57We will have a series of workshops, so later on, once we complete what we started and if the network is growing and people are okay with working together, then we can move on with the systematic empirical papers also, no problem
01:46:12So we'll see how, and I'll try to give you different options because nowadays there's a huge debate among researchers about which software we need to use and how to write good empirical papers
01:46:26So we will cover that part also
01:46:29Yeah, that is also a good platform if we can join; most of the participants have already commented down there
01:46:56If you want to work in the group, it is very beneficial, and also you can..
01:46:58um, I
01:47:01I think you can meet each other on the Facebook page
01:47:04Also, we'll try to send you more and more information on systematic literature reviews
01:47:10Okay, impact factor publications
01:47:11Yes, systematic literature reviews are very popular now
01:47:19If you look at good journals, such as Sustainability, _Frontiers_, MDPI, and others, including Sage Publications, they all publish good literature review papers
01:47:34Okay, so it is very relevant and practical
01:47:36If you follow the steps I told you in the methodology, your research will definitely have scientific quality
01:47:43So, you can publish your work very easily
01:47:47Okay, that is also possible
01:47:51Thank you very much, everybody
01:47:53Take care of yourselves
01:47:56We are in very uncertain times
01:47:58Take care of yourself, your friends, and family
01:48:02Everybody should stay at home and utilize this time to do their research, and that’s why I took this opportunity to teach you about systematic reviews so you can do it easily
01:48:16Thank you very much, and have a nice day
01:48:18We will upload or share the next session next week
01:48:22So, I hope everybody will be online to complete this pending session
01:48:26Thank you very much, and good night.
本次研讨会主要分为三个部分：理解系统文献综述的基础知识、学习其论文模板以及准备最终手稿。 
