Evaluation prototypes
From LiquidPubWiki
This section briefly describes a prototype, recently implemented, of a tool whose main functionality is the evaluation of CS and engineering research authors through citations analysis. Moreover, instructions about how to contribute either in the implementation, or just by leaving a feedback, are provided.
Contents |
Description and pointers
Taking inspiration by existing standalone applications like Herzing's Publish or Perish and digital libraries services integration (for instance CiteseerX statistics computation), we developed a web-based tool, in order to improve some of the previous cited works and, also, to introduce new features concerning the assessment in the research field.
The tool is online and can be found here(server) or here(applet): its functionalities are explained further in the linked pages. As you can see, there are two different versions of the tool: more details will be provided in the next sections.
What does it have to do with the LiquidPub project?
The idea is to embed part of the evaluation tool's functionalities in the performance center module that will be part of the LiquidPub platform. Among other things, we would like to be able to calculate, possibly through customizable metrics, the impact of the research outcomes achieved by a certain researcher or to point out which are the top research groups in a particular topic by analyzing statistics related to their members. Hence, the tool is a sort of alpha-prototype, that clearly has to be refined and improved, that eventually will be embedded in the LiquidPub platform performance module.
Different versions of the tool: what does it change?
Actually, there are two different versions of the tool: one of them is applet-based, namely it runs on client side, with the help of the Java applet technology. Therefore, the applet-based version of the tool works in a decentralized fashion, similar to the approach followed by Herzing's Publish or Perish: the main difference is that you don't have to manually download the application and run it as a standalone program. Moreover, if the user trusts us, he or she can share the information retrieved in the process with us.
The other version follows instead a centralized approach (all the requests pass through our server and are stored in a database for further computations) and is characterized by a "classic" website structure.
Source and documentation
The source code will be open to everybody who would like to read it or modify it, but, at the moment, since the development is in a very early phase, we restricted the access to our repository to registered people only. If you are interested in the code, please send an email to our administrator (and project member) Mario Passamani to get an account.
On the other hand, documentation is freely accessible from our TRAC server.
Collaboration
If you are interested, we gently ask you to provide us some feedback about ranking errors, bugs, or simply to post comments or suggest new features you would like to be inserted. The mean to do that is to open a new ticket in our project-related TRAC server, under the section called new ticket.
External references
- The server-side version of the tool: http://wiki.liquidpub.org:8080/rankTool3
- The applet-based version of the tool: http://dit.unitn.it/~krapivin/pandp/pap.html
- SVN and development repository (registered people only): https://dev.liquidpub.org/svn/paptool-server
- TRAC server related to the project (server version): https://dev.liquidpub.org/trac/paptool-server
