listserv messages

Replied by Belter, Christopher (NIH/OD/ORS) [E] on 06/29/2017 - 12:31
Yes and no. On the one hand, some of these publications like the National Academies book and the Cochrane Handbook do go into some detail about the effects of the methodology on the results and reliability of meta-analyses. And the short answer there is perhaps unsurprising: the more rigorous the meta-analysis is, the more reliable the results tend to be. And the opposite is also true: less rigorous data collection, synthesis, and analysis tends to result in less reliable recommendations.   But the whole question of systematic review and meta-analysis... [Read more]  
Replied by Stephen Fiore on 07/01/2017 - 16:29
Hi Everyone - I'm glad to see a lot of discussion around this topic.  Remember that this is a "Request for Information".  One of the purposes of these is to see what folks think about the topic and how to help evolve the topic as something researchable (and help clear up misconceptions or anything vague in the topic).  Given the variety of ideas/insights discussed in this thread, I'd encourage some of you to consider drafting a response to this RFI as I'm sure the program manager would appreciate your input on the topic. I'm attaching a PDF of the full RFI as it provides... [Read more]  

Posted by Bornmann, Lutz on 06/27/2017 - 00:16
It would be definitely interesting to study empirically the quality of available publications lists. However, it is best practice in bibliometrics that publication lists of single researchers which are used for research evaluation purposes are validated by the researchers themselves. Thus, I expect higher quality lists from databases for which I know that researchers have produced/ controlled their lists. Von meinem iPad gesendet Am 26.06.2017 um 20:37 schrieb William Gunn <>: Please... [Read more]  

Posted by Julia Ingrid Lane on 06/26/2017 - 13:20
HiThose who are interested in working with the UMETRICS data being collected and integrated at the Institute for Research on Innovation and Science ( will be delighted to know that the first tranche of data are also now available through the Census Federal Statistical Research Data Center network.  Additional tranches are expected to be added as the currently 62 university campuses that have committed to join IRIS (accounting for over half of federal university R&D expenditures) send data. ... [Read more]  

Posted by Bornmann, Lutz on 06/21/2017 - 08:26
Dear colleague,   You might be interested in the following paper:   Can the Journal Impact Factor Be Used as a Criterion for the Selection of Junior Researchers? A Large-Scale Empirical Study Based on ResearcherID Data   Early in researchers' careers, it is difficult to assess how good their work is or how important or influential the scholars will eventually be. Hence, funding agencies, academic departments, and others often use the Journal Impact Factor (JIF) of where the authors have published to assess their work and provide resources and... [Read more]  

Posted by Jing Liu on 06/19/2017 - 15:10
Hello, all,Could someone point me to literature (methodology) on looking at research productivity (number of publications and citations) based on English AND non-English journals?  I know databases like SCOPUS have non-English journals, but they are not as well indexed or comprehensive as English journals.  Thanks in advance.Jing Liu-- Jing Liu, PhDResearch Area Specialist LeadMichigan Institute for Data ScienceUniversity of MichiganAnn Arbor, MITel: 7347642750    Email: ... [Read more]  
Replied by Caroline Wagner on 06/19/2017 - 20:11
Dear Jing, I should mention that I still have all the data from the paper I sent you in case you want to look at it. Caroline  [Read more]  
Replied by Klochikhin, Evgeny on 06/20/2017 - 03:43
Hi Jing, We have done a systematic literature review on an education-related subject in Latin America in about 10 different databases in five languages (English, Spanish, Portuguese, Dutch, and French). The search itself is based on duplicating the Boolean-based search strings in multiple languages, which might be tricky. We started to do the same multilingual search in a different subject and it was much harder to align English and Chinese, for instance. What is more complex is estimating the relevance of retrieved documents after you export them. Different... [Read more]  
Replied by Sugimoto, Cassidy Rose on 06/20/2017 - 11:09
You may find this work of interest:  [
Replied by Pikas, Christina K. on 06/20/2017 - 12:37
I think a lot really depends on which country, which language, and which subjects.   (the mention of product names is not intended as an endorsement by me or my employer)   For example, for China, you should probably also go directly to CNKI.   Often, when people use WoS, they’re relying on the Core Collection. They now also offer Korean Citation Database, Russian Science Citation Index, SciELO Citation Index, etc. I believe each of these is also available through the database producer in the native language, as well.     ... [Read more]  
Replied by Jing Liu on 06/20/2017 - 15:49
Hello, everyone, this is great!  I know there is a lot of work out there in this area, but the replies give me a very good start!On Tue, Jun 20, 2017 at 3:17 PM, <> wrote:Gabriel Velez-Cuartas, Diana Lucio-Arias, and Loet Leydesdorff, Regional and Global Science: Latin American and Caribbean publications in the SciELO Citation Index and the Web of... [Read more]  
Replied by koen on 06/21/2017 - 05:43
Dear Jing in case useful in addition: Vincent Lariviere & Eric Archambault have done some potentially relevant work on this. see e.g. the ISSC World Social Science Report 2010 for the social sciences and the work they cite on it on natural sciences as well.... [Read more]  

Posted by Stephen Fiore on 06/16/2017 - 16:27
There is a new paper out comparing country level productivity and national/international research collaborations.  It appears to have more of a policy agenda than anything, but folks might find it helpful. I've cut-and-pasted the bottom line below.  Best, Steve “…there is a shift toward US-international collaboration instead of US-based research coupled with a decline in US-based research published in high-ranking journals (Figure 1). The increase in US-international collaboration is more obvious in high-ranking than mid-ranking journals, suggesting that... [Read more]  
Replied by Phillips on 06/16/2017 - 18:22
This article may just be parroting the Insight piece, but says much the same: ---- ICTPI’17, the International Conference on Technology Policy & Innovation, Taipei, 27-29 Sept., 2017. Fred Phillips, Distinguished Professor College of Management, Yuan Ze University... [Read more]  
Replied by Brooke Struck on 06/19/2017 - 10:18
The conclusions of the JCI study (and the article writing it up in Mic) seem to be highly speculative. The US is increasing its publication output, but more slowly than the global average. Over the 2004-2014 period, China increased its total output by a factor of 3.6, while the US increased its own by a factor of about 1.3. Global output increased by a factor of about 1.8. The US accounts for 10% of global increase, while China accounts for about 30% of it. International collaboration rates have also been increasing, worldwide, over that time frame. Along that dimension, the US is... [Read more]  

Posted by Angelina Wangsha on 06/12/2017 - 09:56
Dear members, You are warmly invited to join Palgrave Macmillan for a panel discussion entitled:   Where next for evidence and policy in post-Brexit Britain?   The event takes place on June 22nd in London (15:30—17:30).   This free panel event, chaired by Prof James Wilsdon (University of Sheffield), will explore what is, and should be, the future of ‘evidence-based policymaking’ in post-Brexit Britain, and how should ‘experts’ engage to make sure that their evidence is heard.   Event synopsis The referendum on Brexit... [Read more]  

Posted by Loet Leydesdorff on 06/11/2017 - 10:15
Inga A. Ivanova, Øivind Strand, Duncan Kushnir, and Loet Leydesdorff, Economic and Technological Complexity: A Model Study of Indicators of Knowledge-based Innovation Systems, Technological Forecasting and Social Change 120 (July 2017) 77-89; doi: 10.1016/j.techfore.2017.04.007. Free access until July 26, 2017 at• Patent Complexity index (PatCI) is... [Read more]  

Posted by Stephen Fiore on 06/09/2017 - 02:45
Hi Everyone - I'm looking forward to seeing those of you who can make it to Clearwater Beach, FL next week for the 2017 Science of Team Science Conference, June 12-14.  We've got a great program lined up for you and you can view it at the link below.    If you plan on attending, please don't forget to register as it helps us for planning purposes.  The relevant links for that, and hotel and travel info, are below. We open the conference Monday with a set of workshops designed to meet the needs of our diverse stakeholder groups. This includes... [Read more]