This blog contains posts related to data warehouse. All posts are used in my real time project and can be used as reusable codes and helpful to BI developers.
Labels
Apache Hadoop
(3)
ASP.NET
(2)
AWS S3
(2)
Batch Script
(3)
BigQuery
(21)
BlobStorage
(1)
C#
(3)
Cloudera
(1)
Command
(2)
Data Model
(3)
Data Science
(1)
Django
(1)
Docker
(1)
ETL
(7)
Google Cloud
(5)
GPG
(2)
Hadoop
(2)
Hive
(3)
Luigi
(1)
MDX
(21)
Mongo
(3)
MYSQL
(3)
Pandas
(1)
Pentaho Data Integration
(5)
PentahoAdmin
(13)
Polybase
(1)
Postgres
(1)
PPS 2007
(2)
Python
(13)
R Program
(1)
Redshift
(3)
SQL 2016
(2)
SQL Error Fix
(18)
SQL Performance
(1)
SQL2012
(7)
SQOOP
(1)
SSAS
(20)
SSH
(1)
SSIS
(42)
SSRS
(17)
T-SQL
(75)
Talend
(3)
Vagrant
(1)
Virtual Machine
(2)
WinSCP
(1)
Wednesday, July 4, 2012
SQL 2012 FORMAT() Function
Formatting in T-SQL - SQL 2012
SELECT
FORMAT(GETDATE(), 'yyyy-MM-dd') AS [ISO_Date],
FORMAT(GETDATE(), 'yyyy-MM-dd hh:mm:ss') AS [ISO_Date_time],
FORMAT(GETDATE(), 'MMMM dd, yyyy') AS [EN_DateFormat],
FORMAT(GETDATE(), 'MMMM dd, yyyy', 'fr-FR') AS [French_Format],
FORMAT(22.7, 'C', 'en-US') AS [US_Currency],
FORMAT(22.7, 'C', 'en-GB') AS [UK_Currency],
FORMAT(99 * 2.226, '000.000') AS [Decimal],
FORMAT(12345678, '0,0') AS [Thousand Separator]
;
SELECT
FORMAT(GETDATE(), 'yyyy-MM-dd') AS [ISO_Date],
FORMAT(GETDATE(), 'yyyy-MM-dd hh:mm:ss') AS [ISO_Date_time],
FORMAT(GETDATE(), 'MMMM dd, yyyy') AS [EN_DateFormat],
FORMAT(GETDATE(), 'MMMM dd, yyyy', 'fr-FR') AS [French_Format],
FORMAT(22.7, 'C', 'en-US') AS [US_Currency],
FORMAT(22.7, 'C', 'en-GB') AS [UK_Currency],
FORMAT(99 * 2.226, '000.000') AS [Decimal],
FORMAT(12345678, '0,0') AS [Thousand Separator]
;
SQL 2012 Throw function
As like in C#, a new function THROW is introduced in SQL 2012 to make try and catch error method more simple instead of using RAISEERROR.
BEGIN TRY BEGIN TRANSACTION -- Start the transaction
DELETE FROM Customers
WHERE EmployeeID = @EmpID -- Commit the change
COMMIT TRANSACTION
END TRY
BEGIN CATCH
ROLLBACK TRANSACTION
THROW
END CATCH
BEGIN TRY BEGIN TRANSACTION -- Start the transaction
DELETE FROM Customers
WHERE EmployeeID = @EmpID -- Commit the change
COMMIT TRANSACTION
END TRY
BEGIN CATCH
ROLLBACK TRANSACTION
THROW
END CATCH
Pagination OFFSET and FETCH Commands in SQL 2012
A new built-in functions for pagination is introduced in SQL 2012. Using this we can skip 'n' number of top rows and retrieve other rows.
CREATE TABLE dbo.Employee
(
ContactId int IDENTITY(1,1) NOT NULL,
FirstName varchar(60),
LastName varchar(60),
Phone varchar(60),
Email nvachar(100)
LocationID int
);
INSERT INTO dbo.Employee
Select firstname, lastname, phone, EmailId, LocationID
FROM dbo.EmployeeAddress
The below query skip top 100 rows and retrieves the next 10 records:
SELECT ContactId, FirstName, LastName, Phone
FROM dbo.Employee
ORDER BY ContactId
OFFSET 100 ROWS
FETCH NEXT 10 ROWS ONLY;
CREATE TABLE dbo.Employee
(
ContactId int IDENTITY(1,1) NOT NULL,
FirstName varchar(60),
LastName varchar(60),
Phone varchar(60),
Email nvachar(100)
LocationID int
);
INSERT INTO dbo.Employee
Select firstname, lastname, phone, EmailId, LocationID
FROM dbo.EmployeeAddress
The below query skip top 100 rows and retrieves the next 10 records:
SELECT ContactId, FirstName, LastName, Phone
FROM dbo.Employee
ORDER BY ContactId
OFFSET 100 ROWS
FETCH NEXT 10 ROWS ONLY;
Monday, July 2, 2012
Configure Change Data Capture Parameters in SQL Server
After enabling CDC in SQL Server (see: http://mahadevanrv.blogspot.in/2011/05/change-data-capture-in-sql-server.html). We can modify the retention period and the number of transactions that to be handled in Change Data Capture table.
Before configureing one should understand the basic terms in CDC Configuration:
Execute the below query to get the CDC configured values:
Execute the below query to change capture instances:
EXEC sys.sp_cdc_change_job @job_type = 'capture'
,@maxtrans = 501
,@maxscans = 10
,@continuous = 1
,@pollinginterval = 5
Execute the below query to change retention period:
EXEC sys.sp_cdc_change_job @job_type = 'cleanup'
,@retention = 4320 -- Number of minutes to retain (72 hours)
,@threshold = 5000
Using this method we can use CDC hold the required period of historical data, i.e., for last 1 month, last 1 year or last 10 days, etc.
Pentaho SQL SERVER 2012 Data Connection Issue
If you face any issue in connecting to SQL SERVER 2012/SQL SERVER by Pentaho Date Connection, then download JTDS driver for sql server (jtds-1.2.5-dist) and load it in the below location:
"~\biserver-ce\tomcat\webapps\pentaho\WEB-INF\jtds-1.2.5-dist"
Now restart the pentaho server, and create new sql server connection.
"~\biserver-ce\tomcat\webapps\pentaho\WEB-INF\jtds-1.2.5-dist"
Now restart the pentaho server, and create new sql server connection.
Thursday, June 28, 2012
Use of RequiredFieldValidator and CompareValidator in ASP.NET
RequiredFieldValidator Control: On using this control we can raise an error message when a field in blank or null, i.e., we can define a field as mandatory.
CompareValidator Contro: This control help us to compare value of one field to another field and raise error message based on the condition we defined.
Below is the sample code where we validate StartDate and EndDate for null values using RequiredFieldValidator and compare Startdate with Enddate value using CompareValidator.
<tr>
<td colspan ="6" rowspan ="3" align ="left"><asp:RequiredFieldValidator ID="RequiredFieldValidator1" runat="server" ControlToValidate="StartDatePr" ErrorMessage="Start Date should not be null." Display ="Dynamic"></asp:RequiredFieldValidator></td>
</tr>
<tr>
<td colspan ="6" rowspan ="3" align ="left"><asp:RequiredFieldValidator ID="RequiredFieldValidator4" runat="server" ControlToValidate="EndDatePr" ErrorMessage="End Date should not be null." Display ="Dynamic"></asp:RequiredFieldValidator></td>
</tr>
<tr>
<td colspan ="6" rowspan ="3" align ="left"><asp:CompareValidator ID="CompareValidator1" runat="server" ControlToCompare="StartDatePr" ControlToValidate="EndDatePr" ErrorMessage="End Date should be greater than Start Date." Operator="GreaterThan" Type="Date" Display ="Dynamic"></asp:CompareValidator></td>
</tr>
</table>
CompareValidator Contro: This control help us to compare value of one field to another field and raise error message based on the condition we defined.
Below is the sample code where we validate StartDate and EndDate for null values using RequiredFieldValidator and compare Startdate with Enddate value using CompareValidator.
<tr>
<td colspan ="6" rowspan ="3" align ="left"><asp:RequiredFieldValidator ID="RequiredFieldValidator1" runat="server" ControlToValidate="StartDatePr" ErrorMessage="Start Date should not be null." Display ="Dynamic"></asp:RequiredFieldValidator></td>
</tr>
<tr>
<td colspan ="6" rowspan ="3" align ="left"><asp:RequiredFieldValidator ID="RequiredFieldValidator4" runat="server" ControlToValidate="EndDatePr" ErrorMessage="End Date should not be null." Display ="Dynamic"></asp:RequiredFieldValidator></td>
</tr>
<tr>
<td colspan ="6" rowspan ="3" align ="left"><asp:CompareValidator ID="CompareValidator1" runat="server" ControlToCompare="StartDatePr" ControlToValidate="EndDatePr" ErrorMessage="End Date should be greater than Start Date." Operator="GreaterThan" Type="Date" Display ="Dynamic"></asp:CompareValidator></td>
</tr>
</table>
Subscribe to:
Posts (Atom)
