The client
A young investment and private equities specialist dealing specifically in mortgage backed securities.

The challenge

This startup company needed systems that would enable it to operate in the equity trading industry while avoiding a large broker and operations staff.

They wanted not only to integrate their trading, pricing, settlement and risk analysis systems, but also to transmit data to market and banking institutions using their own custom software.

Without fully automated systems, the sheer volume of data would have been impossible for our client to manage and thus made it impossible for them to open for business. The stakes were high, and the project risks were significant.

What WCI did

Using ETL (Extract, Transfer, and Load) and integration tools, WCI developed a unique way of connecting diverse source systems.

Such a project has its own set of unusual problems that require unique and creative solutions. For example, we implemented reporting and analysis tools to gauge the effectiveness of the systems and evaluate performance of the trading operation.

Scope of solution

The project engaged a WCI team during a 9-month period. For the last 2 months, after completion of the development phase, the team was halved to complete the remaining analytic work, system maintenance, and coaching/transition.

The technologies used on this project included ETL & integration tools, Automate, PGP, SQL Server, and report development and metadata management studios.

WCI also instituted processes for change of scope/functionality, test scenarios, and auditing of all software outputs. We coached the client’s staff on development and maintenance of ETL jobs and submitted full documentation with process flows and data mappings.

The result

Our client was able to open and begin trading on time, with all systems operating as intended in the fault intolerant industry of equity trading.

The client

A private student loan company with about $400 million in loans assets. It has been operating for two years and in the next year expects to grow to $1 billion in funds distributed.

The challenge

As a startup, the company sought help in developing a short- and mid-term BI strategy for their information management. This included data warehousing, BI software product adoption, IT resource staffing and solution deployment.

Reporting had been based on spreadsheet software. In a company of less than 100 employees, three disconnected BI efforts were in place, and their system suffered from a series of problems:

  • Conflicting reports eroded confidence in the usefulness of the information
  • Competitive data and confidential information was accessible to too many people
  • The entire process required a high degree of manual intervention

As the company grows, they want to be prepared to handle more data sources and more data volume.

They’ll also want to answer more complex questions. For instance, they’ll want to know how loan assets are performing, what credit tiers are in their portfolio, how loans are being paid back, the delinquency and index for each population of credit score and other information.

They will eventually have their own call center to service loans. Then data such as average handle time, abandonment and call arrival patterns will be necessary to help them manage their workforce and call quality.

What WCI Did

In order to catalog the relationship between the data and the decision-making process, we performed a thorough audit. Our resulting BI strategy document and executive presentation addressed solutions around data warehousing, IT staffing, systems integration, reporting and dashboard deployment. We also developed preliminary designs and implementation plans.

As a result, WCI performed the following:

  • Deployed an enterprise Business Intelligence platform to more than 25 end users
  • Provided expertise in data security policy and secure system implementation
  • Trained and coached the IT staff in report and dashboard development

For 4 months WCI stayed in contact with the CIO and attended the company’s internal meetings to ensure that the new strategy was compatible with their business plan. Such close involvement continues to this day.

The company’s goal is to become self-sufficient. An internal reporting department will administer the new system and create reports and dashboards for power users, while stakeholder departments will create their own reports. These include marketing, product development, finance, credit management, sales, business development, operations and client relations departments.

Scope of Solution

One WCI consultant worked 120 days on site to formulate the BI strategy, and then, over the next four months, assisted in implementing the first phase initiatives.

To date, WCI has served their IT, Finance, Sales, Operations (Client Relations), Operations (Call Center), Marketing (Product development), Marketing (General), and Credit departments.

The technologies used were SQL Server 2005 Integration Services (SSIS) and SQL Server DTS.

Full suite of Dashboard, Business Intelligence and reporting technologies utilized.

The application, backoffice and related technology was Embarcadero ER/Studio.

The Results

Improvements increased visibility into processes. Key wins as a result of this visibility:

  • Based on data from this system, one change in procedures resulted in a 15% improvement in the rate of conversion in online (direct) channel.
  • The client attracted more borrowers by promising applicants increased access to information about the status of their loans.

The tools eliminated inconsistent and invalid data from the reporting process, reducing confusion and improving decision insight.

Sizeable resources were also reclaimed when employees tasked with reporting shifted their focus from producing data back to analyzing it.

Adding full BI infrastructure and development resource staff resulted in a self-sufficient reporting and information operation. Definitions of data were mooted, and process over effective dialogue around metadata was implemented.

Corporate dashboards transformed the company from a ‘push’ information methodology to an on-demand environment, delivering the most up-to-date information to the right people as they need it

Automated Data Management Using AWS Serverless Framework

National Consumer Panel Automates Data Management using a Serverless Framework on AWS

IM电竞网站 helped the National Consumer Panel (NCP) automate the management of consumer panel data by designing and developing a serverless framework using  Amazon Web Services .


The  National Consumer Panel  (NCP) is a joint venture between Nielsen and IRi – the two leading consumer insight providers in the United States. They are a market research panel that focuses on measuring consumer attitudes and behavior. Since 1987, NCP has been gathering panel member’s opinions and shopping data to help manufacturers and retailers make informed decisions on what products to develop, improve or sell in the market.


NCP came to WCI with the challenge of handling the processing, validation and auditing of consumer panel data, feedback, receipts and reward payment.  Each consumer panel member is invited to participate in special programs and surveys and in return gain rewards.  The goal of the WCI solution was to simplify and automate the entire process.


The first step in the process was selecting Amazon Web Services (AWS) which allowed NCP to quickly scale to demand without expensive hardware purchases. Utilizing a serverless architecture & native AWS services proved to be the most efficient way of preparing for a workload that could be highly unpredictable.

Architecture Creation & Validation

  • WCI started by building API Gateway endpoint to receive receipt requests captured in the existing NCPMobile app by panelists.
  • With the use of S3, Lambda and SQS, we created tasks for Turk workers responsible for transcribing panelist receipts.
  • Build Lambda function triggered by API gateway endpoint to create HIT tasks for transcribing receipts.
  • For each received receipt create Mechanical Turk HIT for which input screen was built and manually tested. In order to audit the process, Lambda was used to suspend the autopay service
  • For each step of the process a persisted record was created and updated with the use of DynamoDB.
  • Data is streamed from the DynamoDB tables to an Aurora instance using Kinesis Streams.
  • The data from the Aurora instance is used to populate a Quicksight dashboard for analysis on the number of transcriptions being done and the number of unique workers working on those tickets.

The engagement with NCP required utilizing a broad array of services on AWS, including:

Amazon Elastic Compute Cloud (Amazon EC2)Amazon Relational Database Service (Amazon RDS), Amazon Glue, Amazon Athena, Kinesis Streams, Amazon CloudWatch, Amazon Simple Queue Service (Amazon SQS), AWS Lambda, Amazon Virtual Private Cloud Peering (VPC-Peering), Amazon QuickSight, AWS Identity and Access Management (IAM) and Amazon Simple Storage Service (Amazon S3).


NCP was able to automate the management of consumer panel data using a serverless framework, which enabled them to save reduce labor costs and avoid significant investments in hardware.

Not sure how to begin your journey adopting AWS? Let WCI be your guide.

Explore AWS Solutions

About IM电竞网站

WCI is a consulting services company focused on the application of data through the use of  Business Intelligence  and  Data Warehouse  technologies that bring increased business performance for our clients. WCI has serviced well over 300 companies through our knowledge and expertise of how to make data valuable to decision-makers.

友情链: 新IM电竞平台首页 im电竞直播大厅-新出的电竞竞猜 | im电竞官网 _ im电竞在线官网首页-电竞体育平台排名前十 | IM电竞平台注册 - im电竞官方app下载 电竞体育官网首页 | IM电竞登录-im电竞滚盘官网_电竞体育真人竞猜注册送 | im电竞永久官网-im电竞比分网官网登录|电竞体育平台送彩金 | im电竞比分网~亚博IM电竞足球~电竞竞猜贴吧最新 | im电竞下注 IM电竞专业电竞平台-电竞竞猜推荐平台 |