devbox
weixin_40725706
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

分享一下：上传文件到亚马逊的S3，并从指定桶里面拉取文件_spring boot 上传文件到amazon s3

作者：weixin_40725706 | 2024-03-22 06:07:08

赞

踩

spring boot 上传文件到amazon s3

这里给出两种方法 

后端Java

  1. 首先看AWS s3 （这里不放图了）

登录你的AWS   通过账号密码，进入s3 ，   并在设置-》安全凭证里面 创建一个密钥  （这个是访问密钥，不是你的登录账号和密码）

创建一个桶，记住你创建的桶名称   因为后面访问的时候需要  桶名称

咱们 上传文件需要   3个参数

 访问密钥    和  桶名称

  2. 打开你的idea   

  •  2.1  导入依赖

  1. <dependency>
  2.     <groupId>software.amazon.awssdk</groupId>
  3.     <artifactId>s3</artifactId>
  4. </dependency>
  5. <!-- https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3 -->
  6. <dependency>
  7.     <groupId>com.amazonaws</groupId>
  8.     <artifactId>aws-java-sdk-s3</artifactId>
  9.     <version>1.12.523</version>
  10. </dependency>

  • 2.2 创建一个测试的类

  1. package com.gupaoedu;
  2.  
  3. import java.io.*;
  4. import com.amazonaws.auth.AWSCredentials;
  5. import com.amazonaws.auth.BasicAWSCredentials;
  6. import com.amazonaws.regions.Region;
  7. import com.amazonaws.regions.Regions;
  8. import com.amazonaws.services.s3.AmazonS3;
  9. import com.amazonaws.services.s3.AmazonS3Client;
  10. import com.amazonaws.services.s3.model.*;
  11. import com.amazonaws.services.s3.transfer.TransferManager;
  12. import com.amazonaws.services.s3.transfer.Upload;
  13. import org.springframework.stereotype.Service;
  14.  
  15.  
  16. /**
  17.  * @author DELL
  18.  * @Desc S3上传文件客户端
  19.  */
  20. @Service
  21. public class TestType {
  22.     //访问密钥 的安全凭证中 找  没有则创建一个
  23.     private static String AWS_ACCESS_KEY = "*****";
  24.     private static String AWS_SECRET_KEY = "*****";
  25.     private static final String BUCKETNAME = "visa-application-system"; //桶名
  26.     private static AmazonS3 s3;
  27.     private static TransferManager tx;
  28.  
  29.  
  30.  
  31.     /**
  32.      * 通过在代码中包含 access key id 和 secret access key 连接 aws
  33.      * @throws Exception
  34.      */
  35.     private static void init_with_key() throws Exception {
  36.         AWSCredentials credentials = null;
  37.         credentials = new BasicAWSCredentials(AWS_ACCESS_KEY, AWS_SECRET_KEY);
  38.         s3 = new AmazonS3Client(credentials);
  39.         Region usWest2 = Region.getRegion(Regions.AP_NORTHEAST_1); // 你的时区
  40.         s3.setRegion(usWest2);
  41.         tx = new TransferManager(s3);
  42.     }
  43.     /**
  44.      * 上传一个本地文件(对应位置为path)上传到名为bucketName的bucket
  45.      * @param path
  46.      * @param bucketName
  47.      */
  48.     private static boolean uploadFileToBucket(String bucketName,String path) {
  49.         // 通过你传入的文件路径  打开你的本地文件
  50.         File fileToUpload = new File(path);
  51.         if(fileToUpload.exists() == false) {
  52.             System.out.println(path + " not exists!");
  53.             return false;
  54.         }
  55.         // 桶名、     存入桶里面的文件名字（自定义）（如果时多级目录  传入全路径）、   通过你传入的文件路径打开的文件
  56.         PutObjectRequest request = new PutObjectRequest(bucketName,fileToUpload.getName(),fileToUpload);
  57.         Upload upload = tx.upload(request);
  58.         while((int)upload.getProgress().getPercentTransferred() < 100) {
  59.             try {
  60.                 Thread.sleep(1000);
  61.             } catch (InterruptedException e) {
  62.                 // TODO Auto-generated catch block
  63.                 e.printStackTrace();
  64.                 return false;
  65.             }
  66.         }
  67.         System.out.println(path + " upload succeed!");
  68.         return true;
  69.     }
  70.  
  71. // 传入要拉去的文件名
  72.     private static Boolean downloadrelease(String bucketname,String filename,String windowspath) throws IOException {
  73.         //  下载文件 ( 桶名，文件夹名+文件名 ) 因为这是直接在桶下面  所以 只有文件名
  74.         // 如果你是多级目录 需要 传入你的文件夹加你的文件名    例如：  test/file。pdf
  75.         S3Object s3Object = s3.getObject(new GetObjectRequest(bucketname,  filename));
  76.         if (s3Object != null) {
  77.             InputStream inputStream = null;
  78.             FileOutputStream fileOutputStream = null;
  79.             byte[] data = null;
  80.             try {
  81.                 // 通过你 要下载桶中文件名称（ 可以传多级目录   但需要 截取要下载到本地的文件名   之后和你要下载的本地路径相拼接）
  82.                 File file = new File(windowspath+"\\"+filename);
  83.  
  84.                 if (!file.exists()) {
  85.                     file.createNewFile();
  86.                 }
  87.                 //获取S3object对象文本信息
  88.                 inputStream = s3Object.getObjectContent();
  89.                 data = new byte[inputStream.available()];
  90.                 int len = 0;
  91.                 fileOutputStream = new FileOutputStream(file.getPath());
  92.  
  93.                 while ((len = inputStream.read(data)) != -1) {
  94.                     fileOutputStream.write(data, 0, len);
  95.                 }
  96.                 System.out.println(("*********下载文件成功!*********"));
  97.             } catch (IOException e) {
  98.                 e.printStackTrace();
  99.             } finally {
  100.                 if (fileOutputStream != null) {
  101.                     try {
  102.                         fileOutputStream.close();//文件流关闭
  103.                     } catch (IOException e) {
  104.                         e.printStackTrace();
  105.                     }
  106.                 }
  107.                 if (inputStream != null) {
  108.                     try {
  109.                         inputStream.close();//文件流关闭
  110.                     } catch (IOException e) {
  111.                         e.printStackTrace();
  112.                     }
  113.                 }
  114.  
  115.             }
  116.         }
  117.         return true;
  118.     }
  119.  
  120.     public static void main(String[] args) throws Exception {
  121.         // 根据你的 访问密匙  初始化S3 对象
  122.         init_with_key();
  123.  
  124.         //传入 你要上传 到的桶名称，     和你上传的本地文件全路径
  125.         boolean b = uploadFileToBucket(BUCKETNAME, "C:\\Users\\Administrator\\Desktop\\代码\\file2023-08-28.pdf");
  126.         if(b){
  127.             System.out.println("上传成功");
  128.         }else {
  129.             System.out.println("上传失败");
  130.         }
  131.  
  132.          /*
  133.          *
  134.          * 下载文件 这里我只传入了三个参数
  135.          *  1，桶名称
  136.          * 2.  桶中的文件名称     或多级文件目录 文件名称例如    files/pdfs/file.pdf
  137.          * 3. 下载到本地路径
  138.          * */
  139.         Boolean downloadrelease = downloadrelease(BUCKETNAME, "file2023-08-28.pdf", "C:\\Users\\Administrator\\Desktop\\代码");
  140.         if(downloadrelease){
  141.             System.out.println("下载成功");
  142.         }else {
  143.             System.out.println("下载失败");
  144.         }
  145.  
  146.         System.exit(0);
  147.     }
  148.  
  149.  
  150. }

  1. 2.3.其他的一些方法

    1.  /**
    2.      * 用于创建一个名为bucketName的s3 bucket
    3.      * @param bucketName
    4.      */
    5.     private  void createBucket(String bucketName) {
    6.         if(s3.doesBucketExist(bucketName) == true) {
    7.             System.out.println(bucketName + " already exist!");
    8.             return;
    9.         }
    10.         System.out.println("creating " + bucketName + " ...");
    11.         s3.createBucket(bucketName);
    12.         System.out.println(bucketName + " has been created!");
    13.     }
    14.  
    15.     /**
    16.      * 列出名为bucketName的bucket里面的所有object
    17.      * @param bucketName
    18.      */
    19.     private  void listObjects(String bucketName) {
    20.         System.out.println("Listing objects of " + bucketName);
    21.         ObjectListing objectListing = s3.listObjects(bucketName);
    22.         int objectNum = 0;
    23.         for(S3ObjectSummary objectSummary : objectListing.getObjectSummaries()) {
    24.             System.out.println(" - " + objectSummary.getKey());
    25.             objectNum ++;
    26.         }
    27.         System.out.println("total " + objectNum + " object(s).");
    28.     }
    29.  
    30.     /**
    31.      * 判断名为bucketName的bucket里面是否有一个名为key的object
    32.      * @param bucketName
    33.      * @param key
    34.      * @return
    35.      */
    36.     private  boolean isObjectExit(String bucketName, String key) {
    37.         int len = key.length();
    38.         ObjectListing objectListing = s3.listObjects(bucketName);
    39.         String s = new String();
    40.         for(S3ObjectSummary objectSummary : objectListing.getObjectSummaries()) {
    41.             s = objectSummary.getKey();
    42.             int slen = s.length();
    43.             if(len == slen) {
    44.                 int i;
    45.                 for(i=0;i<len;i++) {
    46.                     if(s.charAt(i) != key.charAt(i)) {
    47.                         break;
    48.                     }
    49.                 }
    50.                 if(i == len) {
    51.                     return true;
    52.                 }
    53.             }
    54.         }
    55.         return false;
    56.     }
    57.  
    58.     /**
    59.      * 在本地创建一个名为filename的文件，输入一些信息后，将其传到名为bucketName的s3 bucket里面去
    60.      * @param bucketName
    61.      * @param filename
    62.      * @throws IOException
    63.      */
    64.     private  void createSampleFile(String bucketName, String filename) throws IOException {
    65.         if(isObjectExit(bucketName, filename) == true) {
    66.             System.out.println(filename +" already exists in " + bucketName + "!");
    67.             return;
    68.         }
    69.         System.out.println("creating file " + filename);
    70.         File file = new File(filename);
    71.         file.deleteOnExit();
    72.  
    73.         Writer writer = new OutputStreamWriter(new FileOutputStream(file));
    74.         writer.write("abcdefghijklmnopqrstuvwxyz\n");
    75.         writer.write("01234567890112345678901234\n");
    76.         writer.write("!@#$%^&*()-=[]{};':',.<>/?\n");
    77.         writer.write("01234567890112345678901234\n");
    78.         writer.write("abcdefghijklmnopqrstuvwxyz\n");
    79.         writer.close();
    80.  
    81.         s3.putObject(bucketName, filename, file);
    82.         System.out.println("create sample file " + filename + " succeed!");
    83.     }
    84.  
    85.     /**
    86.      * 输出"s3://"+bucketname+"/"key对应的object对应的信息
    87.      * @param bucketName
    88.      * @param key
    89.      */
    90.     private static String showContentOfAnObject(String bucketName, String key) {
    91.  
    92.         S3Object object = s3.getObject(new GetObjectRequest(bucketName, key));
    93.         InputStream input = object.getObjectContent();
    94.         return object.getKey();
    95. //        BufferedReader reader = new BufferedReader(new InputStreamReader(input));
    96. //        try {
    97. //            while (true) {
    98. //                String line = reader.readLine();
    99. //                if (line == null) {
    100. //                    break;
    101. //                }
    102. //                System.out.println("    " + line);
    103. //            }
    104. //            System.out.println();
    105. //        } catch (IOException e) {
    106. //            e.printStackTrace();
    107. //        }
    108.     }
    109.  
    110.     /**
    111.      * 输出"s3://"+bucketname+"/"key对应的object对应的信息(这个object对应的文件时gzip格式的)
    112.      * @param bucketName
    113.      * @param key
    114.      */
    115.     private  void showContentOfAnGzipObject(String bucketName, String key) {
    116.         try {
    117.             S3Object object = s3.getObject(new GetObjectRequest(bucketName, key));
    118.             InputStream input = new GZIPInputStream(object.getObjectContent());
    119.             BufferedReader reader = new BufferedReader(new InputStreamReader(input));
    120.  
    121.             while (true) {
    122.                 String line = reader.readLine();
    123.                 if (line == null) {
    124.                     break;
    125.                 }
    126.                 System.out.println("    " + line);
    127.             }
    128.             System.out.println();
    129.         } catch (IOException e) {
    130.             e.printStackTrace();
    131.         }
    132.     }
    133.  
    134.  
    135.     /**
    136.      * 删除一个名为bucketName的bucket
    137.      * @param bucketName
    138.      */
    139.     private  void deleteBucket(String bucketName) {
    140.         if(s3.doesBucketExist(bucketName) == false) {
    141.             System.out.println(bucketName + " does not exists!");
    142.             return;
    143.         }
    144.         System.out.println("deleting " + bucketName + " ...");
    145.         ObjectListing objectListing = s3.listObjects(bucketName);
    146.         for(S3ObjectSummary objectSummary : objectListing.getObjectSummaries()) {
    147.             String key = objectSummary.getKey();
    148.             s3.deleteObject(bucketName, key);
    149.         }
    150.         s3.deleteBucket(bucketName);
    151.         System.out.println(bucketName + " has been deleted!");
    152.     }
    153.  
    154.     /**
    155.      * 删除名为bucketName的bucket里面所有key的前缀和prefix匹配的object
    156.      * @param bucketName
    157.      * @param prefix
    158.      */
    159.     private  void deleteObjectsWithPrefix(String bucketName, String prefix) {
    160.         if(s3.doesBucketExist(bucketName) == false) {
    161.             System.out.println(bucketName + " does not exists!");
    162.             return;
    163.         }
    164.         System.out.println("deleting " + prefix +"* in " + bucketName + " ...");
    165.         int pre_len = prefix.length();
    166.         ObjectListing objectListing = s3.listObjects(bucketName);
    167.         for(S3ObjectSummary objectSummary : objectListing.getObjectSummaries()) {
    168.             String key = objectSummary.getKey();
    169.             int len = key.length();
    170.             if(len < pre_len) {
    171.                 continue;
    172.             }
    173.             int i;
    174.             for(i=0;i<pre_len;i++) {
    175.                 if(key.charAt(i) != prefix.charAt(i)) {
    176.                     break;
    177.                 }
    178.             }
    179.             if(i < pre_len) {
    180.                 continue;
    181.             }
    182.             s3.deleteObject(bucketName, key);
    183.         }
    184.         System.out.println("All " + prefix + "* deleted!");
    185.     }
    186.  
    187.  
    188.     /**
    189.      * 列出我的s3上所有的bucket的名字
    190.      */
    191.     private  void listBuckets() {
    192.         System.out.println("Listing buckets");
    193.         int bucketNum = 0;
    194.         for(Bucket bucket : s3.listBuckets()) {
    195.             System.out.println(" - " + bucket.getName());
    196.             bucketNum ++;
    197.         }
    198.         System.out.println("total " + bucketNum + " bucket(s).");
    199.     }
    200.  
    201.  
    202.     /**
    203.      * 在aws上创建一个目录
    204.      * @param bucketName
    205.      * @param folderId
    206.      */
    207.     private static String createFolder(String bucketName, Integer folderId) {
    208.         // Create metadata for my folder & set content-length to 0
    209.         ObjectMetadata metadata = new ObjectMetadata();
    210.         metadata.setContentLength(0);
    211.         // Create empty content
    212.         InputStream emptyContent = new ByteArrayInputStream(new byte[0]);
    213.         // Create a PutObjectRequest passing the foldername suffixed by /
    214.         String folderName=FOLDERNameLIST+folderId+"/"; // 创建文件目录
    215.         PutObjectRequest putObjectRequest =
    216.                 new PutObjectRequest(bucketName, folderName,
    217.                         emptyContent, metadata);
    218.         // Send request to S3 to create folder
    219.         s3.putObject(putObjectRequest);
    220.         return folderName;
    221.     }

    前端Vue  下载（不是上传）

1. 首先，确保已安装AWS SDK for JavaScript。

npm install aws-sdk

2.导入包

  1. // 在<script>  标签中 导入  前提是 你把aws  install 在你的项目中
  2. import AWS from 'aws-sdk';

3. 定义单机事件方法

  1. // 在vue method 代码块中 定义  单机按钮   调用方法
  2.  
  3. downloadImage(filename) {
  4.       // 配置AWS SDK
  5.       AWS.config.update({
  6.     // 你的访问密钥
  7.         accessKeyId: '******',
  8.         secretAccessKey: '*****',
  9.         region: 'ap-northeast-1' // 你的时区
  10.       });
  11.  
  12.       const s3 = new AWS.S3();
  13.         // 桶名
  14.       const bucketName = '***';
  15.         //文件名    或者文件全路径名             桶名/ [文件夹名/] *.*
  16.       const key = '***/*.*';
  17.        
  18.       // 创建下载链接
  19.       const params = {
  20.         Bucket: bucketName,
  21.         Key: key
  22.       };
  23.  
  24.       s3.getSignedUrl('getObject', params, (err, url) => {
  25.         if (err) {
  26.           console.error('无法生成签名URL：', err);
  27.         } else {
  28.           // 使用生成的URL下载图片
  29.           window.open(url);
  30.         }
  31.       });
  32.     }

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/weixin_40725706/article/detail/285783
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号