Saturday, February 21, 2015

Working with Compression on HDFS

Copy and uncompress file to HDFS without unziping the file on local filesystem

If your file is in GB's then this command would certainly help to avoid out of space errors as there is no need to unzip the file on local filesystem.

put command in hadoop supports reading input from stdin. For reading the input from stdin use '-' as source file.

Compressed filename: compressed.tar.gz
  
gunzip -c  compressed.tar.gz | hadoop fs -put - /user/files/uncompressed_data

Only Disadvantage: The only drawback of this approach is that in HDFS the data will be merged into a single file even though the local compressed file contains more than one file.

Practically used it today...while working with realtime problem...

Thanks to below blogger
http://bigdatanoob.blogspot.com/2011/07/copy-and-uncompress-file-to-hdfs.html

Sunday, February 15, 2015

Big Data solution for My Retail client

We wanted to provide best marketing campaigns, coupons, and offers down to the individual customer. Direct customer relationships are a privilege, but it  also requires processing the  massive amounts of data to provide the best winning prices to the customer at point of sale is one of the complex task .Our client is using Hadoop to process large data. The Merchants generates the offers into the portals for particular week or month on the basis of regular price , promotional price & Clearance price ,  for the group of products and for group market across the globe.Based on promotional offers transaction, we conduct explosion of data using Hadoop by generating the promotional offers to help retailers make informed decisions about pricing, promotions, and assortment management. These offers then flow into the Hadoop system for further processing.We explode these offers using PIG and HIVE for all the products and store across the globes. In product explosion we generate the promotions data for all the products which belongs to product groups. In market explosion we explode these data for respective stores across the globe. The details about the product group and market category during product explosion and market explosion ,we get from the internal datawarehouse. During these transformations we check store authorization for the category of that product for respective stores and many complex business rules. Based on this data, the Hadoop calculates the optimal promotional retail price for product. The billons of promotional data set then generated and processed using Hadoop PIG and HIVE transformations. We do chaining and collision within generated promotional data. Then out of billion records we categorize the winning price or winning data and looser data. Hadoop provides a near complete ecosystem where we run batch and ETL-type processing, analytics, store data, and process data faster for billions of records. We store data in HDFS and process data using HIVE and PIG that enable analytics of this promotional dataset. We run multiple transformation jobs and deliver information to multiple systems. We then send this winning data (after pricing optimization) every day to our point of sale (retails stores), where during the purchasing of retail product by customer, our associate will provide the promotional price applicable to that particular time. We also send this winning data and looser data to our datawarehouse for reporting purpose to our merchants so that they can generate BI reporting out of that. 

Saturday, December 6, 2014

What’s New in IBM Cognos 10.2 (Now we can use it for Big Data too)


Cognos Workspace (Formerly Business Insight) It seems a little strange to say we’re glad that IBM Cognos 10.2 delivers fewer “insights”, but the renaming of Business Insight and Business Insight Advanced to Cognos Workspace and Cognos Workspace Advanced respectively, is a welcome change. Hopefully this will help to ease some of the confusion that’s arisen in recent years among a myriad of “insight” labeled components in within the IBM Business Analytics solution portfolio. Along with this re-branding, come a number of useful new features.
Multi Tabbed Workspaces A major enhancement to Cognos Workspace is the ability to easily create multi-tab workspaces enabling you to expand your workspace’s visual footprint without the need to scroll. With tabbed workspaces also comes a new control known as an Action Button which can be programed to trigger tab changes.
Freeze and Unfreeze Column and Row Headers Excel users rejoice, they’ve added the functionality to freeze and unfreeze crosstab column and row headers while scrolling. Data Visualization Guide As mentioned previously, the theme of applied data visualization theory is a recurring one in Cognos 10.2. The new Visual Recommender in Cognos Workspace will help you to select the appropriate chart type based on the data values in your workspace, along with some insightful rationale for that decision.
Graduated Capabilities Administrators can now assign graduated capabilities to the Cognos Workspace tool. Users can have the option of Authoring, Interacting or just Consuming any Cognos Workspace. This is useful in controlling the available Cognos Workspace feature set for governance purposes, or to even further simplify the experience to drive adoption in a user population of diverse skill sets.
Other Features Cognos workspace 10.2 also brings support for printing and use in Google Chrome and Safari.
Cognos Mobile Cognos Mobile was a major focus in the 10.1 (General) and 10.1.1 (Refresh Pack) releases, with outstanding functionality and support across a broad set of devices. In 10.2 Mobile sees a few minor, but noteworthy updates.
  •  Push Notifications Cognos Mobile now supports push notifications to the status IOS status bar in the iPad app – users can now be notified when a new version of their report is available, further reducing the latency in decision making on the go. Improved Performance of Multi-page Reports Multi-page reports can now be streamed to devices, reducing the loading time. Users no longer have to wait for the entire report to download before viewing.
  • Administrators Can Now Secure Mobile Access A new mobile capability in Cognos Administration allows administrators to govern access to Cognos via Mobile devices. This has benefits from a governance perspective for all organizations that deploy Cognos Mobile, especially those that employ a Bring Your Own Device (BYOD) policy
  • Report Studio Prompt API The new prompt API is a long overdue and welcome update to Professional Authors and Report Studio hackers everywhere. The API is 100% documented and supported, and like any good API can be expected to persist across future product renditions. The API provides a documented method for setting, reading, deleting and validating prompt values using JavaScript. The API is supported in Report Studio, Cognos Viewer, Cognos Workspace and Cognos Workspace Advanced. 
  • Excel Improvements Expect improved Excel compatibility of Cognos report outputs with increased spreadsheet maximums to 16,384 columns by 1,048,576 rows. Cognos 10.2 also brings a brand new Excel output format called Excel 2007 Data which is perfect for lightweight data transfer to Excel without any report formatting. 
  • Dynamic Cubes By far the most exciting new feature in Cognos 10.2 is the addition of a new OLAP technology to the IBM Cognos solution suite which in conjunction with pre-existing OLAP options provides developers with the option of the right tool for the job at hand.The Dynamic Cube solution builds upon existing Dynamic Query Mode (DQM) functionality to close a major gap that exists in many vendor OLAP offerings: the organization with a large or mature star or snowflake schema data warehouse that wants to provide an OLAP experience to their users without sacrificing data details or high performance. Here are a few highlights of this new feature:
  • Big Data Support: Hadoop / Hive via JDBC Connector SQL Server and Analysis Services 2012 Salesforce.com (Native DQM) SAP ECC (R3) (Native DQM) Siebel (Native DQM) The big news here is native support for Big Data and seamless integration with IBM InfoSphere BigInsights (Hadoop). Additionally, native support for a number of ERP vendors has been added to Cognos via Dynamic Query Mode for increased performance and reduced implementation complexity. Prior to 10.2, support for data sources such as Saleforce.com, SAP ECC and Siebel required a connector via Virtual View Manager (VVM). We should also note that VVM 10.2 will be the final release of this solution, and while it will continue to be supported, developers should take note that it is now deprecated in favor of DQM. 100% 64 Bit These remaining 32 bit components of IBM Cognos 10 get an update for full 64 bit compatibility: BI Gateway, Metric Studio and Data Manager Multi-Tenant Support Cognos 10.2 now supports native multi-tenancy. While this feature may not have mass appeal, it will be incredibly valuable to certain IBM Cognos OEM partners as well as organizations that have deployed Cognos in a federated manner and are looking to more easily segment different business units or sub-organizations within their shared IBM Cognos platform architecture. 
  • Content Archiving Last but not least, Cognos 10.2 now natively supports fully integrated content archiving to a file system. This feature will be coveted by organizations that have content retention and audit requirements that are looking to keep their Cognos content store free from large report outputs to maximize their environmental performance. This new feature has much of the same archival functionality that IBM FileNet customers have enjoyed since the 10.1.1 release.

Cognos Insight

Finally I got some time to learn and update myself on  IBM BI latest tools.
Its been 7+ years I have been working in Cognos BI tool.
The Cognos Insight will be the next big thing in the market because IBM beautifully integrated TM1 and Cognos BI workspace capabilities in Cognos Insight 10.2 version.

Cognos Insight 10.2 Cognos Insight, released in Early 2012, is the Personal Analytics solution that has taken the marketplace and user’s desktops by storm, garnering a #1 ranking among all Self Service Business Intelligence Platforms in The Forrester Wave (Q2 2012). Cognos 10.2 continues to improve ease of use, and integration with IBM Cognos Enterprise to encourage collaboration and enterprise distribution while avoiding data silos that other competitive solutions can create. What’s the use of personal insight if the entire organization cannot stand to benefit?
Tree Maps Customers and Partners alike have clamored for improved data visualizations and IBM has responded in kind. The addition of Tree Maps to Cognos Insight pays homage to the applied data visualization theories of luminaries such as Edward Tufte and Stephen Few and it is a theme that is quite prevalent in Cognos 10.2. Unfortunately, we’ll have to wait for Tree Maps in the enterprise studios as this is a Cognos Insight-Only feature for now.
Smart Metadata A new data discovery engine in Cognos Insight will automatically detect dimensional levels in hierarchies and even differentiate between numeric attributes and measures. This means users will spend even less time importing data, further shortening the learning curve of this already intuitive platform.
Drill-able, Drag and Drop Charting and Top/Bottom Filtering Users can now drill up and down directly on charts, just as is possible in Cognos Enterprise, and they can also drag and drop dimensions and measures directly onto charts as opposed to having to retain a crosstab in prior versions. Also included is rapid top/bottom filtering in Crosstabs that is always a simple right click away.
Package Import Prior to this latest, release users could import data into Cognos Insight from existing IBM Cognos Reports. IBM takes the story of unified metadata one step further allowing users to source data directly from the same ad-hoc reporting packages that are published in the Cognos Enterprise environment. For IT and business alike this means master data management and data governance from the enterprise to the desktop: unified business logic and terminology at every step of the way.
Time Rollups Cognos Insight now has out-of-box functionality to build custom time dimensions or roll-ups. Populate entire years regardless of how sparse your data may be or customize it to match your organizations fiscal calendar.
High Fidelity Publish Customers who also have IBM Cognos TM1 Enterprise can publish their Cognos Insight dashboards to Cognos 10.2 Enterprise as full-fledged, tabbed Cognos Workspaces. This means that Cognos Insight users can share their analyses with other Cognos Enterprise users who do not have Cognos Insight capabilities. This is huge from both a customer licensing and a usability perspective as prior releases required that any users who wanted to view an Insight dashboard must have Cognos Insight capabilities, which came at the higher Advanced Business Author licensing level. To view a Cognos Workspace a user need only be at popular Enhanced Consumer license tier. What’s a Cognos Workspace you ask?

Go through some training videos below is the link.

http://ibmtvdemo.edgesuite.net/software/analytics/cognos/videos/HTVs/ci102/index.html

It has what if analysis ,budgeting and planning and visualization capabilities.
It automates the development of TM1 applications which reduces the time for end to end deployment for small or medium applications.
It completely based on self service model which provide lot of capability to end users to get  their things done without involvement of IT.
I am sure in upcoming versions IBM will leverage this tool with lot of capabilities for data visualization on Big data or HDFS (Lets see).

I think we can replace the transformer cubes by using the Cognos insight by publishing the CDD workspace file on IBM Cognos BI Connection as workspace.


I will be going to start POC soon.
Let me know what other folks think about Cognos Insight.


Monday, August 29, 2011

Features list for Mobile Reporting

Few days back, I got an opportunity to prepare features list for Mobile reporting solution tool.
We all know that days are not too far when everyone will move to I pad/touch-pad or Smartphone to access the real time BI applications.
Mobile Users need business intelligence data wherever they are to make information-driven decisions. Whether it’s salespeople who wants product details or executives who need bird eye view of the business. Mobile BI apps should be able to deliver information by providing interactive reports, dashboards, metrics and other to user’s mobile devices.
There are lot of tools available in the market.
Having knowledge of these features certainly helped me understand the tool better.
I can now use this feature list to compare various options which are available in the market so as to give informed consultancy to my clients.
My personnel opinion is for Cognos go mobile because in version 10 they leverage lot of functionality to satisfy the needs for mobile users.

Below is the link to feature list:


https://docs.google.com/spreadsheet/ccc?key=0AiobrRxK74dwdGpzQjYyMW92b052WnFJZ2xjbndveGc&hl=en_US

Wednesday, March 30, 2011

Diplaying the List Column header in Vertical mode

Some time we need to display the column header in vertical mode.
You can rotate the text 90 degrees by using the TextFlow & Justification property for the column titles and set the Writing Mode to "Top to Bottom, Left to Right" You will find this by clicking on the column title in the report and then scrolling down in the Properties for the title on the left hand side.

Tuesday, December 21, 2010

Schedule an Entry/Report Based on an Occurrence/Trigger

As part of setting up trigger-based scheduling, you must schedule an entry based on an occurrence.

Trigger-based schedule is activated if the user firing the trigger has:

read and traverse permissions for the schedule entry

traverse permissions for all ancestors of the schedule entry

access to IBM Cognos Administration

Steps
Click the schedule button next to the entry you want to schedule.

Under Frequency, click the By Trigger tab.

In Trigger name, type the name of the trigger occurrence.

Note: The trigger name that you enter may be provided to you by your administrator or developer. If not, you must inform your administrator or developer of the trigger name that you use.

The default start date is "now", and the default end date is "forever", which means the trigger schedule runs when the trigger is fired (either from trigger.bat or from an SDK application). If you enter a valid start and end date, the trigger schedule can only be fired between those dates.

Click OK.


Set Up a Trigger Occurrence on a Server

As part of setting up trigger-based report scheduling , you must set up the trigger occurrence on a server. You link the external occurrence, such as a database refresh or an email, with a trigger on the server that causes the entry to run. You must also specify the name of the occurrence.

Trigger occurrences can also be set up by an SDK developer using the IBM Cognos 8 software development kit (SDK). For more information, see the The IBM Cognos 8 SDK Developer Guide.

Scripts
Using the Windows script named trigger.bat or the shell script named trigger.sh, you can trigger one or more schedules to run on the server.

The script syntax follows where URL is the IBM Cognos 8 server URL, username is a valid username in the specified namespace, password is the password for the username, namespace is the namespace for the username, and triggerlist is a comma separated list of trigger names:

trigger.bat URL [username password namespace]
triggerlist
For example, if users want to schedule a report based on a database refresh and want to schedule a second report based on receipt of an email, your custom trigger command line may look similar to this:

trigger.bat http://localhost:9300/p2pd/servlet/dispatch username
password namespace databaserefreshtriggername,emailtriggername
Steps
If you are setting up a trigger occurrence on a server other than an IBM Cognos 8 server, complete the following tasks:

Ensure that the server has a supported version of either a Java Runtime Environment or a Java Development Kit.

Copy the following files from c8_location/webapps/p2pd/WEB-INF/lib on an IBM Cognos 8 server to the location on the server where you are setting up the trigger occurrence:

activation.jar

axis.jar

axisCrnpClient.jar

commons-discovery.jar

commons-logging.jar

jaxrpc.jar

saaj.jar

mail.jar

xml-apis.jar

xercesImpl.jar


Copy the following files from c8_location/webapps/EventTrigger on an IBM Cognos 8 server, to the location on the server where you are setting up the trigger occurrence:

trigger.bat

trigger.sh

trigger.class (a Java utility that can run on any IBM Cognos-supported platform)


Ensure that the command line runs when the external occurrence, such as a database refresh or email, occurs.

The mechanism that you use to invoke your custom trigger command depends on the application that you are working with, such as a database system or an email application. For information, see the documentation for your application.

Inform users that they can now schedule entries based on the trigger occurrence.

If a user scheduled an entry based on the occurrence, when the user clicks the schedule button for a report view, occurrence information replaces frequency information on the Schedule page.

If a user scheduled an entry based on the occurrence, when the user clicks the schedule button for a report view, occurrence information replaces frequency information on the Schedule page.

After the script runs, the trigger method returns an integer value representing the number of schedules that were run. The following integers represent errors:

-1 is a usage error, such as invalid parameter or syntax

-2 is a communication problem with IBM Cognos 8 server

Thursday, November 18, 2010

Why is TM1 in limelight?

Only product in market that can be used for “OLAP Analysis” & “Planning” using “Multiple cubes” stored “in-Memory” .
Earlier, TM1 was available in 32bit technology. Limitation is 2 GB RAM. Targeted at solutions having limited data.
With introduction of 64 bit Technology, the available RAM is upto 1TB. This enabled TM1 to target solutions that handle large amount of data.
Sparcity removing algorithm.
Post Cognos Acquisition, TM1 is on long term road map of IBM.

Wednesday, October 27, 2010

Business intelligence for all Cognos 10

Cognos 10 BI

IBM Cognos BI provides users with many options to access information. Each
option uses common functions and interfaces. Executives can take IBM Cognos
Active reports offline to keep working while out of the office. Information
consumers and executives can access reports, charts, and other business
intelligence objects using dashboards from IBM Cognos Business Insight. IBM
Cognos Advanced Business Users and Professional Report Authors can use
IBM Cognos Business Insight Advanced to create new IBM Cognos BI objects
and to analyze information from any source and from new perspectives. Users
familiar with office productivity tools can use IBM Cognos Analysis for MS Excel
to blend the power of IBM Cognos BI information with the personal workspace of
Excel. Users on the go can use IBM Cognos Mobile to stay connected to their
IBM Cognos BI information.

Stay connected I am going to expalin each feature in details ......

Tuesday, October 26, 2010

IBM Cognos 10 Redbook link and new features detail...

Face The Truth: IBM Cognos 10 Redbook link and new features detail...: "IBM Cognos 10 RedBook Link to the Book http://www.redbooks.ibm.com/redbooks/pdfs/sg247912.pdf Some of the Feature I like: New dynamic qu..."

IBM Cognos 10 Redbook link and new features details

IBM Cognos 10 RedBook
Link to the Book
http://www.redbooks.ibm.com/redbooks/pdfs/sg247912.pdf


Some of the Feature I like:

New dynamic query capability. Optimized caching, in-memory calculations, 3x faster query

Cognos admins can export all system metrics to a RDBMS and then analyze with Business Insight(new Dashboard tool integrated in COgnos 10).

The UI works very well and looks very well thought out.

Allows end user to manage their own login credentials reducing the load on IT.

we should more intensively use upgrade manager

Improved content manager performance through caching and faster olap in memory caching

New external data wizard for Cognos10 Report Studio. A feature that supports and encourages agile development

No more messy javascript to modify prompt object text - they are now modifiable properties in cognos10 (this is the best)

http://ow.ly/i/4UH1




Go! Search looks to be included in #Cognos10.

Monday, October 25, 2010

Cognos 10 -Bussiness Insight

Business Insight provides an integrated business intelligence experience for business users. This webbased tool allows you to use IBM Cognos content to build sophisticated interactive dashboards that facilitate collaborative decision making. These dashboards can include traditional business intelligence assets, along with Real Time Monitoring information, TM1 Websheets and CubeViews, as well as external data.

Tuesday, March 23, 2010

To Add Connection to LDAP sever:

• Right click on ‘Directory Server’ and say ‘Add connection’.
• A pop-up will appear as shown in the snapshot below.
• Add the following details in the pop-up
Add host: Cognos url
Port : 389
Base DN : o=organization.com


The connection is added.

Now we see the ‘Default’ namespace under the Directory Server.

Under the default namespace we see

  • User
  • Root User Class
  • Application Server
  • Data Source

To make LAE :

Right click on the namespace and say ‘Export to .LAE’



Scheduling Reports

Scheduling Reports
You can schedule reports to run at a time that is convenient for you, such as during off hours when demands on the system are low.
You can schedule reports individually or in a group by using a job. You can schedule reports to run by minute, hourly, daily, weekly, monthly, or yearly.
Only one schedule can be associated with each report or job. If you require multiple schedules for the same report, you can create report views and then create a schedule for each report view. Jobs have their own schedules, and these schedules are independent from report schedules.
After you create a schedule, the report or job runs at the time and date specified. You can then manage the properties of your schedules.
Prompts in Scheduled Reports
If a report that contains prompts is scheduled, you must save the prompt values or specify default values to ensure that values exist when the report runs according to the schedule.
In a job, you can specify prompt values for job steps. When a report runs as part of a job, the prompt values saved in the job definition are used instead of the values saved with the report. If no values are specified in the job definition, ReportNet uses the values saved in the report.
SCHEDULE A REPORT
You schedule a report to run it at a later time or at a recurring date and time.
If you no longer need a schedule, you can delete it. You can also disable it without losing any of the scheduling details. You can then enable the schedule at a later time.
ReportNet keeps history information and report outputs each time a report runs according to a schedule. You can specify how many occurrences to keep or for how long to keep them. For example, you can keep the history and report outputs for the ten latest occurrences or for schedules that ran in the last two months. Use the report history to see the times at which the reports ran and whether the reports ran successfully.
To schedule a report or report view, you must have read, write, execute, and traverse permissions for it. You also require the following access permissions to any data sources used by the report.
• dataSource - Execute and Traverse
• dataSourceConnection - Execute and Traverse
(With only Execute access, you are prompted to log on to the database.)
• dataSourceSignon - Execute

Schedule Multiple Reports at Once

You can set the same schedule for multiple reports by creating a job. A job identifies a collection of reports, report views, and other jobs that are scheduled together and share the same schedule settings. When a scheduled job runs, all the reports in the job run.

Jobs contain job steps, which are references to individual reports, jobs, and report views. You can specify whether to run the steps all at once or in sequence.

When the steps are run all at once, all the steps are submitted at the same time. The job is successful when all the steps run successfully. If a step fails, the other steps in the job are unaffected and still run, and the job has a Failed status.

When the steps are run in sequence, you can specify the order in which the steps run. A step is submitted only after the preceding step runs successfully.

The individual reports, jobs, and report views in steps can also have individual schedules.

To schedule a report or report view, you must have read, write, execute, and traverse permissions for it. You also require the following access permissions to all data sources used by the report.

  • dataSource - Execute and Traverse
  • dataSourceConnection - Execute and Traverse

(With only Execute access, you are prompted to log on to the database.)

  • dataSourceSignon - Execute

Schedule a Report Based on an Event

You can schedule a report based on an event, such as a database refresh. You specify an event to act as a trigger. When that event occurs the report runs.

This functionality is also available through Event studio.


Friday, February 12, 2010

Start Query Studio in Preview Mode

You can configure Query Studio to start in preview mode. Users can then create or modify reports without retrieving actual data from the database. Instead, simulated data is shown.

If you later upgrade IBM Cognos 8, you must reapply this configuration.
Steps

1. Using IBM Cognos Configuration, stop IBM Cognos 8.
2. Rename the c8_location\templates\ps\async\system.xml.sample file to
system.xml.
Tip: To restore the regular mode, rename the
c8_location\templates\ps\async\system.xml file to system.xml.sample.

3. Using IBM Cognos Configuration, start IBM Cognos 8.

Unsupported IBM Cognos 8 Formatting

About 30% of the formatting functions available in IBM Cognos 8 are not supported in Microsoft Excel. In particular, Excel does not allow changing locale-dependent formatting attributes, such as the following:

Decimal Separator

Exponential Symbol

Group Separator

Monetary Decimal Separator

AM String

Day Name

Day Short Name

Decimal Delimiter Symbol

Month Name

Month Short Name

PM String

In addition, Excel does not support the following:

Format Width

International Currency Symbol

List Separator

Percent Symbol (Excel does not support percent symbols for charts)

Multiplier

Overline Text Format

PerMill Symbol

Plus Sign

Scale (Excel has a different scaling formula than IBM Cognos 8)

Calendar (Excel does not allow changing the calendar)

Era Name

First Day Of Week

Show Era

Saturday, November 21, 2009

(TR0112) There isn't enough memory available

Error:
(TR0112) There isn't enough memory available.

Reason:
"Enable Mutli-Processing" enabled on datasources and the addition of the new datasource appears to push the limitations of this feature based on the size of the data being pulled.
Remove multi-processing from datasources


1. Open the model in Transformer
2. Right click the datasource and select "properties"
3. Click on the General tab
4. Uncheck "enable multi-processing" and click OK
5. Repeat steps 2 through 4 for all data source entries
6. Test / Build


Also ensure that there are enough system resources available when building the cube. This includes plenty of free memory, diskspace, and processor time. For example, if your database is using up 90% of the memory while you attempt to launch rsserver to build cubes, the cube build will fail at some point due to lack of memory available. Lack of memory in this case can also seen via monitoring the syslog (on unix system only) file.

TR1907 Transformer cannot gain access to database

When a cube is automated to rebuild on a regular basis, transformer fails to create the cube due to the failed authentication. Transformer prompts for user password even if the prompt for password box is unchecked in the Signon Property Sheet and Include Access Manager auto-access in the model is checked in the authentication tab of Model Property Sheet.
Error Details:
(TR1907) Transformer can't gain access to database 'Database Name' with signon information 'username'. [->Cancel] PowerPlay Transformer
Reason:
The Database signon is not recognized by Transformer via Access Manager due to an incorrect database name. Database name specified within transformer needs to be exactly the same as the one set up within Access Manager. This is also case sensitive.

Use Access Manager to record the database authentication and set the auto-access to access manager's signon. Cognos common signons are set to flown from Access Manager user class as well as the database signon

Steps:

1. Create the data source in Access Manager Admin Console
2. Add user signos into the user class Administrator
3. Uncheck the box against Prompt for Password in the user signon property sheet
4. Within datasource property sheet, specify the datasource name, which should be exactly the same as the one in Access Manager. The datasource name is case sensitive.
5. Activate "Include Access Manager auto-access in the model" from Authentication tab of the Model Property Sheet

Working with Compression on HDFS

Copy and uncompress file to HDFS without unziping the file on local filesystem If your file is in GB's then this command would cer...