Technology Evaluation

The Fingerprint Vendor Technology Evaluation (FpVTE) 2003 was conducted to evaluate the accuracy of fingerprint matching, identification, and verification systems. Eighteen different companies competed, and 34 systems were evaluated. Different subtests measured accuracy for various numbers and types of fingerprints, using operational fingerprint data from a variety of U.S. Government sources. Accuracy varied greatly among the systems tested. The most accurate systems performed consistently well across a variety of tests. Many types and characteristics of fingerprints were analyzed; the variables that had the clearest effect on system accuracy were the number of fingers used and fingerprint quality. An increased number of fingers resulted in higher accuracy: the accuracy of searches using four or more fingers was better than the accuracy of two-finger searches, which was better than the accuracy of single-finger searches. As the fingerprint image quality improved, the systems' accuracy also improved. The results of FpVTE are based on (1-to-Many) fingerprint matching technologies and capabilities from 2003 so they are very dated and should only be used accordingly. For results on more recent (1-to-1) fingerprint matching technology capabilities, readers should refer to results posted on the Proprietary Fingerprint Template (PFT) testing website: http://fingerprint.nist.gov/PFT. More recent (1-to-1) fingerprint matching technology capabilities using the exchange of standard minutiae templates are posted on the Ongoing Minutiae Exchange (MINEX) website:

Although contemporary technology adoption theories incorporate societal norms or peer references, it is unclear to what extent these factors influence choices. In this research, we apply institutional theory and the concept of mimetic isomorphism as peer influences to the technology evaluation process to determine the degree to which managers conform when selecting between competing information technologies. More specifically, we test if peer influence is sufficient to overcome a product evaluation where the choice is believed to be inferior. An experiment is conducted using the World Wide Web and a national sample of 348 senior information technology and business decision makers. Significant effects are found where inferior technologies are selected if respondents are informed that competitors have selected them. Further research is warranted to investigate the presence and extent of these effects but overall implications are that product evaluations may be more ornamental than substantive.

The complexities of technology generation, transfer, and commercialisation processes have always gravely taxed the way we measure and assess them. This paper reviews the existing metrics for evaluation of science and technology, with emphasis on evaluation of industrial R&D and technology. Among the categories of metrics, this paper reviews econometric methods, patents, process methods, and bibliometric methods. The paper also reviews models of the innovation continuum, in an effort to link such models to the metrics categories. Based on the review of the state of the art, the paper proposes future directions for the development and the application of metrics of technology evaluation. A process-outcomes stage model is outlined and its advantages are listed. This stage-model is suggested as a more effective method to evaluate R&D and technology along the entire innovation continuum.

Abstract Enterprise resource planning (ERP) software is a platform for innovation with high failure rates due to its complexity. In China, failure rates of ERP are also high, with key differences between China and Western countries in terms of development, cultural, and organizational structure. Even when Chinese firms successfully adopt ERP, many fail to assimilate ERP and consequently never experience the full benefits of the innovation. The purpose of this study is to examine the predictors of adoption versus assimilation in Chinese firms. The existing literature largely assumes a dichotomy of choices when implementing organizational innovations in business: technological evaluation and imitation. We argue that this dichotomy does not apply well to a Chinese ERP context. China has achieved tremendous success in manufacturing and industrial processes through technological leapfrogging offered by imitation. At the same time, Chinese firms are under increasing pressure to innovate. Therefore, we argue that forces of imitation and evaluation are likely both at play when Chinese firms adopt and assimilate innovations—including ERP. Accordingly, we examined how two behaviors, interorganizational social technology imitation and rational technology evaluation, influence Chinese organizations in adopting and assimilating ERP systems. Our findings suggest that both social technology imitation and rational technology evaluation are determinants of Chinese ERP adoption and assimilation. Hence, this study offers new ways for IT and innovation researchers to explore social behavior (i.e., imitation) in IT diffusion processes and to consider the merits or risks of such behavior alongside the conventional rational approach (i.e., evaluation).

OBJECTIVE To measure image clarity, ease of use, and handling performance of a flexible fiberoptic bronchoscope (B-F 100; Vision Sciences; Natick, MA) and sterile single-use disposable-sheath endoscope system (BS-F21 EndoSheath; Vision Sciences). DESIGN Prospective, multicenter diagnostic technology evaluation of a medical device newly approved by the US Food and Drug Administration. SETTING Three tertiary care referral centers with busy bronchoscopy practices. PATIENTS Twenty-four patients undergoing bronchoscopy with a flexible fiberoptic bronchoscope and disposable sheath endoscope system. METHODS Flexible bronchoscopy was performed through a transnasal or transoral route after topical upper airway anesthesia using standard techniques. After each procedure, the bronchoscopist rated the performance of the medical device under study using a linear scale of 1 (poor) to 5 (excellent and equal to that of a conventional flexible fiberoptic bronchoscope). RESULTS Mean performance ratings were > 4.0 (range, 4.17 to 4.63) for image clarity, illumination, lack of fogging, distal tip angulation, and ease of transnasal passage. All other ratings were > 3.0 (range, 3.54 to 3.87), the lowest of which was handling comfort. CONCLUSION The flexible fiberoptic bronchoscope with sterile single-use disposable-sheath endoscope system has the potential to reduce scope downtime by eliminating the need for high-level disinfection between procedures. Illumination, image clarity, and ease of insertion are very good, justifying future prospective studies comparing this device to conventional flexible fiberoptic bronchoscopes.

Post-Cold War military conflicts have highlighted the need for a flexible, agile joint force responsive to emerging crises around the globe. The 2005 Joint Capabilities Integration and Development System (JCIDS) acquisition policy document mandates a shift away from stove-piped threat-based acquisition to a capability-based model focused on the multiple ways and means of achieving an effect. This shift requires a greater emphasis on scenarios, tactics, and operational concepts during the conceptual phase of design and structured processes for technology evaluation to support this transition are lacking. In this work, a methodology for quantitative technology evaluation for systems-of-systems is defined. Physics-based models of an aircraft system are exercised within a hierarchical, object-oriented constructive simulation to quantify technology potential in the context of a relevant scenario. A major technical challenge to this approach is the lack of resources to support real-time human-in-the-loop tactical decision making and technology analysis. An approach that uses intelligent agents to create a "Meta-General" capable of forecasting strategic and tactical decisions based on technology inputs is used. To demonstrate the synergy between new technologies and tactics, surrogate models are utilized to provide intelligence to individual agents within the framework and develop a set of tactics that appropriately exploit new technologies. To address the long run-times associated with constructive military simulations, neural network surrogate models are implemented around the forecasting environment to enable rapid trade studies. Probabilistic techniques are used to quantify uncertainty and richly populate the design space with technology-infused alternatives. Since a large amount of data is produced in the analysis of systems-of-systems, dynamic, interactive visualization techniques are used to enable "what-if" games on assumptions, systems, technologies, tactics, and evolving threats. The methodology developed in this dissertation is applied to a notional Long Range Strike air vehicle and system architecture in the context of quantitative technology evaluation for the United States Air Force.

Selective laser melting (SLM) is becoming an economically viable choice for manufacturing complex serial parts. This paper focuses on a geometric complexity analysis as part of the integrative technology evaluation model (ITEM) presented here. In contrast to conventional evaluation methodologies, the ITEM considers interactions between product and process innovations generated by SLM. The evaluation of manufacturing processes that compete with SLM is the main goal of ITEM. The paper includes a complexity analysis of a test part from Festo AG. The paper closes with a discussion of how the expanded design freedom of SLM can be used to improve company operations, and how the complexity analysis presented here can be seen as a starting point for feature-based complexity analysis.

Background Periodic demographic health surveillance and surveys are the main sources of health information in developing countries. Conducting a survey requires extensive use of paper-pen and manual work and lengthy processes to generate the required information. Despite the rise of popularity in using electronic data collection systems to alleviate the problems, sufficient evidence is not available to support the use of electronic data capture (EDC) tools in interviewer-administered data collection processes. Objective This study aimed to compare data quality parameters in the data collected using mobile electronic and standard paper-based data capture tools in one of the health and demographic surveillance sites in northwest Ethiopia. Methods A randomized controlled crossover health care information technology evaluation was conducted from May 10, 2016, to June 3, 2016, in a demographic and surveillance site. A total of 12 interviewers, as 2 individuals (one of them with a tablet computer and the other with a paper-based questionnaire) in 6 groups were assigned in the 6 towns of the surveillance premises. Data collectors switched the data collection method based on computer-generated random order. Data were cleaned using a MySQL program and transferred to SPSS (IBM SPSS Statistics for Windows, Version 24.0) and R statistical software (R version 3.4.3, the R Foundation for Statistical Computing Platform) for analysis. Descriptive and mixed ordinal logistic analyses were employed. The qualitative interview audio record from the system users was transcribed, coded, categorized, and linked to the International Organization for Standardization 9241-part 10 dialogue principles for system usability. The usability of this open data kit–based system was assessed using quantitative System Usability Scale (SUS) and matching of qualitative data with the isometric dialogue principles. Results From the submitted 1246 complete records of questionnaires in each tool, 41.89% (522/1246) of the paper and pen data capture (PPDC) and 30.89% (385/1246) of the EDC tool questionnaires had one or more types of data quality errors. The overall error rates were 1.67% and 0.60% for PPDC and EDC, respectively. The chances of more errors on the PPDC tool were multiplied by 1.015 for each additional question in the interview compared with EDC. The SUS score of the data collectors was 85.6. In the qualitative data response mapping, EDC had more positive suitability of task responses with few error tolerance characteristics. Conclusions EDC possessed significantly better data quality and efficiency compared with PPDC, explained with fewer errors, instant data submission, and easy handling. The EDC proved to be a usable data collection tool in the rural study setting. Implementation organization needs to consider consistent power source, decent internet connection, standby technical support, and security assurance for the mobile device users for planning full-fledged implementation and integration of the system in the surveillance site.

This paper presents the technology evaluation process in the US electronics manufacturing industry. Eleven major groups of evaluation attributes were identified: Flexibility and Efficiency, Strategic Attributes, Manufacturing Floor Requirements, Product Development, Tactical Costs, Strategic Costs, Competitiveness, Operational Social Concerns, Strategic Social Concerns, Uniqueness, and Industry Trends. They utilise three major groups of evaluation methodologies: Analytic Tools, Financial Tools, and Modelling Tools. Two major impacts resulting from the technology acquisitions have been identified in this study. The resulting impacts are: Organisational and Operational Competitiveness, Market and New Product Development Competitiveness.

Key features are presented of the Exitech MS-13 EUV Microstepper tool developed for EUV resist testing & technology evaluation at the 32nm node and beyond. Details of the tool design architecture, module layout, vacuum chamber, major subsystems including source, optics and performance specifications are given.