Labels

Apache Hadoop (3) ASP.NET (2) AWS S3 (2) Batch Script (3) BigQuery (21) BlobStorage (1) C# (3) Cloudera (1) Command (2) Data Model (3) Data Science (1) Django (1) Docker (1) ETL (7) Google Cloud (5) GPG (2) Hadoop (2) Hive (3) Luigi (1) MDX (21) Mongo (3) MYSQL (3) Pandas (1) Pentaho Data Integration (5) PentahoAdmin (13) Polybase (1) Postgres (1) PPS 2007 (2) Python (13) R Program (1) Redshift (3) SQL 2016 (2) SQL Error Fix (18) SQL Performance (1) SQL2012 (7) SQOOP (1) SSAS (20) SSH (1) SSIS (42) SSRS (17) T-SQL (75) Talend (3) Vagrant (1) Virtual Machine (2) WinSCP (1)

Tuesday, October 6, 2015

How to Overwrite Text File Data in to Postgres table?

Overwriting text file data in to Postgres table

Consider I have a text file in the location 'D:\Users\test.txt' and I need to update/insert these data into postgres table dbo.Test.

My text file has two column ID and Location with '|' delimiter.

CREATE TEMPORARY TABLE t_test as SELECT * FROM dbo."Test" LIMIT 0;

COPY t_test ("ID","Location") from 'D:\Users\test.txt' WITH DELIMITER '|' CSV HEADER;

SELECT "ID" from t_test;

BEGIN TRANSACTION;

DELETE  FROM dbo."Test"
WHERE   "ID" IN
        (
        SELECT  "ID"
        FROM    t_test
        );

INSERT  INTO dbo."Test"
SELECT  "ID", "Location"
FROM    t_test;

COMMIT TRANSACTION;